[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:36:41 dist-test-slave-t3q3 krb5kdc[25409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:36:41 dist-test-slave-t3q3 krb5kdc[25409](info): set up 2 sockets
Aug 10 01:36:41 dist-test-slave-t3q3 krb5kdc[25409](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 01:36:42.512449 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.004s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:36:42 dist-test-slave-t3q3 krb5kdc[25409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:36:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:36:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:36:42.646278 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41791
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:37447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:42.770275 25425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:42.770592 25425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:42.770677 25425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:42.775038 25425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:36:42.775142 25425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:42.775185 25425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:42.775247 25425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:36:42.775287 25425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:36:42.780839 25425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:42.782382 25425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:42.783598 25425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:42.796248 25437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:42.796687 25436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:42.796638 25439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:42.797729 25425 server_base.cc:1034] running on GCE node
I20260810 01:36:42.798496 25425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:42.800313 25425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:42.801508 25425 hybrid_clock.cc:648] HybridClock initialized: now 1786325802801482 us; error 40 us; skew 500 ppm
Aug 10 01:36:42 dist-test-slave-t3q3 krb5kdc[25409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325802, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:42.804777 25425 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:36:42.806123 25425 webserver.cc:460] Webserver started at http://127.24.205.190:33007/ using document root <none> and password file <none>
I20260810 01:36:42.807034 25425 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:42.807106 25425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:42.807489 25425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:42.810207 25425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "6220101de7b84de6998c3ac4c2394aea"
format_stamp: "Formatted at 2026-08-10 01:36:42 on dist-test-slave-t3q3"
server_key: "d142fa439eb647fea3b3c65334a78e29"
server_key_iv: "c16a046c683debe059096819a55370dd"
server_key_version: "encryptionkey@0"
I20260810 01:36:42.810791 25425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "6220101de7b84de6998c3ac4c2394aea"
format_stamp: "Formatted at 2026-08-10 01:36:42 on dist-test-slave-t3q3"
server_key: "d142fa439eb647fea3b3c65334a78e29"
server_key_iv: "c16a046c683debe059096819a55370dd"
server_key_version: "encryptionkey@0"
I20260810 01:36:42.816200 25425 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 01:36:42.819872 25452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:42.821710 25425 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:36:42.821951 25425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "6220101de7b84de6998c3ac4c2394aea"
format_stamp: "Formatted at 2026-08-10 01:36:42 on dist-test-slave-t3q3"
server_key: "d142fa439eb647fea3b3c65334a78e29"
server_key_iv: "c16a046c683debe059096819a55370dd"
server_key_version: "encryptionkey@0"
I20260810 01:36:42.822064 25425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:42.840559 25425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:42.844338 25425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:42.844578 25425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:42.854806 25425 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:41791
I20260810 01:36:42.854851 25532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:41791 every 8 connection(s)
I20260810 01:36:42.856235 25425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:36:42.861084 25533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:42.863899 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25425
I20260810 01:36:42.864131 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:36:42.866031 25398 external_mini_cluster.cc:1428] Setting key fb68d069b49c6dd48999ec791e8da403
I20260810 01:36:42.872599 25533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea: Bootstrap starting.
I20260810 01:36:42.877480 25533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:42.878983 25533 log.cc:824] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:42.882432 25533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea: No bootstrap required, opened a new log
I20260810 01:36:42.887907 25533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220101de7b84de6998c3ac4c2394aea" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41791 } }
I20260810 01:36:42.888341 25533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:42.888461 25533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6220101de7b84de6998c3ac4c2394aea, State: Initialized, Role: FOLLOWER
I20260810 01:36:42.889366 25533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220101de7b84de6998c3ac4c2394aea" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41791 } }
I20260810 01:36:42.889607 25533 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:36:42.889772 25533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:36:42.889923 25533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:42.891351 25533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220101de7b84de6998c3ac4c2394aea" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41791 } }
I20260810 01:36:42.892032 25533 leader_election.cc:302] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6220101de7b84de6998c3ac4c2394aea; no voters:
Aug 10 01:36:42 dist-test-slave-t3q3 krb5kdc[25409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:42.892506 25533 leader_election.cc:288] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:36:42.892654 25541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:42.892923 25541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [term 1 LEADER]: Becoming Leader. State: Replica: 6220101de7b84de6998c3ac4c2394aea, State: Running, Role: LEADER
I20260810 01:36:42.893481 25541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220101de7b84de6998c3ac4c2394aea" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41791 } }
I20260810 01:36:42.894560 25533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:36:42.895424 25541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6220101de7b84de6998c3ac4c2394aea. Latest consensus state: current_term: 1 leader_uuid: "6220101de7b84de6998c3ac4c2394aea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220101de7b84de6998c3ac4c2394aea" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41791 } } }
I20260810 01:36:42.895558 25541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [sys.catalog]: This master's current role is: LEADER
I20260810 01:36:42.896660 25542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6220101de7b84de6998c3ac4c2394aea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6220101de7b84de6998c3ac4c2394aea" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41791 } } }
I20260810 01:36:42.896879 25542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea [sys.catalog]: This master's current role is: LEADER
I20260810 01:36:42.897291 25548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:36:42.901336 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:42.873552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45960 (local address 127.24.205.190:41791)
0810 01:36:42.873999 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:42.874022 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:42.874095 (+ 73us) server_negotiation.cc:407] Connection header received
0810 01:36:42.879390 (+ 5295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:42.879409 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:42.879959 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:42.880334 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:42.884040 (+ 3706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:42.885117 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:42.887070 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:42.887549 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:42.887673 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:42.893366 (+ 5693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:42.893404 (+ 38us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:42.893421 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:42.893457 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:42.895578 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:42.896493 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:42.896499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:42.896506 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:42.896695 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:42.897211 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:42.897215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:42.897216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:42.897922 (+ 706us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:42.899396 (+ 1474us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:42.899575 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 01:36:42.899892 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":148,"threads_started":1}
I20260810 01:36:42.903707 25548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:36:42.911796 25548 catalog_manager.cc:1347] Generated new cluster ID: 782b62737db34e119223253af8af3e79
I20260810 01:36:42.911868 25548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:36:42.919047 25548 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:36:42.920001 25548 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:36:42.929631 25548 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6220101de7b84de6998c3ac4c2394aea: Generated new TSK 0
I20260810 01:36:42.930529 25548 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:36:42.965222 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41791
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:37447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:43.082630 25577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:43.082885 25577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:43.082928 25577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:43.086935 25577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:43.086993 25577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:43.087086 25577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:36:43.092525 25577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:43.093621 25577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:43.094669 25577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:43.105142 25583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:43.105149 25584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:43.105149 25587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:43.105355 25577 server_base.cc:1034] running on GCE node
I20260810 01:36:43.105847 25577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:43.106452 25577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:43.107618 25577 hybrid_clock.cc:648] HybridClock initialized: now 1786325803107598 us; error 32 us; skew 500 ppm
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:43.110402 25577 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:36:43.111243 25577 webserver.cc:460] Webserver started at http://127.24.205.129:43917/ using document root <none> and password file <none>
I20260810 01:36:43.111820 25577 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:43.111882 25577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:43.112049 25577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:43.114089 25577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "10d646ae71c942e68aa0005a7de14711"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "42fd06ebbd4267613906e39fe431ee01"
server_key_iv: "2549bbd446ad4c4e87255d233fe20666"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.114588 25577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "10d646ae71c942e68aa0005a7de14711"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "42fd06ebbd4267613906e39fe431ee01"
server_key_iv: "2549bbd446ad4c4e87255d233fe20666"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.118207 25577 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:36:43.120673 25596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.122006 25577 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:36:43.122143 25577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "10d646ae71c942e68aa0005a7de14711"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "42fd06ebbd4267613906e39fe431ee01"
server_key_iv: "2549bbd446ad4c4e87255d233fe20666"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.122256 25577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:43.149605 25577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:43.153168 25577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:43.153396 25577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:43.154201 25577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:43.155333 25577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:43.155388 25577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.155431 25577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:43.155447 25577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.168586 25577 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:41443
I20260810 01:36:43.168620 25763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:41443 every 8 connection(s)
I20260810 01:36:43.169581 25577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:36:43.172559 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25577
I20260810 01:36:43.172672 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:36:43.172998 25398 external_mini_cluster.cc:1428] Setting key 68d72cc197684d4b132cc9b5ce1bc42b
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:36:43.185793 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.171973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:47059 (local address 127.24.205.190:41791)
0810 01:36:43.172171 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:43.172175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:43.173829 (+ 1654us) server_negotiation.cc:407] Connection header received
0810 01:36:43.174839 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:43.174842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:43.174897 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:43.174990 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:43.176276 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.177372 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.178625 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.178871 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.178991 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.181696 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:43.181699 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:43.181702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:43.181738 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:43.183450 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.184052 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.184056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.184075 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.184172 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.184549 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.184552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.184554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.184756 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:43.184865 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:43.185461 (+ 596us) server_negotiation.cc:299] Negotiation successful
0810 01:36:43.185611 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 01:36:43.186787 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.172517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41791 (local address 127.24.205.129:47059)
0810 01:36:43.173484 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:43.173545 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:43.174615 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:43.175176 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:43.175182 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:43.175554 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:43.176115 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:43.176138 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.177520 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.177523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:43.178482 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:43.178492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.179034 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.179038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:43.179223 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.179892 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:43.179908 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:43.181520 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:43.183611 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:43.183617 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:43.183633 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:43.183930 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:43.184272 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:43.184276 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:43.184278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:43.184431 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:43.184880 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:43.184889 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:43.185208 (+ 319us) client_negotiation.cc:769] Sending connection context
0810 01:36:43.185404 (+ 196us) client_negotiation.cc:240] Negotiation successful
0810 01:36:43.185756 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":170,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
I20260810 01:36:43.188416 25764 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41791
I20260810 01:36:43.188755 25764 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:43.189656 25764 heartbeater.cc:511] Master 127.24.205.190:41791 requested a full tablet report, sending...
I20260810 01:36:43.192152 25477 ts_manager.cc:194] Registered new tserver with Master: 10d646ae71c942e68aa0005a7de14711 (127.24.205.129:41443)
I20260810 01:36:43.194326 25477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:47059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:36:43.207557 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41791
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:37447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:43.323652 25770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:43.323902 25770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:43.323945 25770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:43.328284 25770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:43.328341 25770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:43.328439 25770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:36:43.333685 25770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:43.334709 25770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:43.335724 25770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:43.345373 25779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:43.345358 25780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:43.345415 25782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:43.345436 25770 server_base.cc:1034] running on GCE node
I20260810 01:36:43.346073 25770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:43.346632 25770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:43.347792 25770 hybrid_clock.cc:648] HybridClock initialized: now 1786325803347758 us; error 46 us; skew 500 ppm
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:43.350528 25770 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:36:43.351416 25770 webserver.cc:460] Webserver started at http://127.24.205.130:38169/ using document root <none> and password file <none>
I20260810 01:36:43.351992 25770 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:43.352106 25770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:43.352344 25770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:43.354369 25770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "c61888c9640040cba7fa1173617af8b9"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "c2f3f34256d3a74aa5e946cb8edcffe4"
server_key_iv: "286037242cb1b9fd2080677d0d4155b9"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.354979 25770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "c61888c9640040cba7fa1173617af8b9"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "c2f3f34256d3a74aa5e946cb8edcffe4"
server_key_iv: "286037242cb1b9fd2080677d0d4155b9"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.358727 25770 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:36:43.361172 25793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.362367 25770 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:36:43.362514 25770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "c61888c9640040cba7fa1173617af8b9"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "c2f3f34256d3a74aa5e946cb8edcffe4"
server_key_iv: "286037242cb1b9fd2080677d0d4155b9"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.362625 25770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:43.388121 25770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:43.391175 25770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:43.391388 25770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:43.391994 25770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:43.392918 25770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:43.393009 25770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.393105 25770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:43.393157 25770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.404985 25770 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:43539
I20260810 01:36:43.405014 25964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:43539 every 8 connection(s)
I20260810 01:36:43.405875 25770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:43.415522 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25770
I20260810 01:36:43.415607 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:36:43.415866 25398 external_mini_cluster.cc:1428] Setting key e8d9d9687cf98d608fc36ce1a4f6d5ce
I20260810 01:36:43.419214 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.407616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:60249 (local address 127.24.205.190:41791)
0810 01:36:43.407781 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:43.407785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:43.408889 (+ 1104us) server_negotiation.cc:407] Connection header received
0810 01:36:43.409733 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:43.409736 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:43.409783 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:43.409858 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:43.410986 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.411513 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.412698 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.412927 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.413020 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.415422 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:43.415425 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:43.415427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:43.415446 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:43.417190 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.417714 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.417722 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.417724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.417798 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.418145 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.418149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.418151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.418329 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:43.418439 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:43.418912 (+ 473us) server_negotiation.cc:299] Negotiation successful
0810 01:36:43.419046 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:36:43.419951 25967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.408016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41791 (local address 127.24.205.130:60249)
0810 01:36:43.408723 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:43.408763 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:43.409549 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:43.410034 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:43.410041 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:43.410383 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:43.410857 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:43.410871 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.411621 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.411624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:43.412591 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:43.412601 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.413086 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.413089 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:43.413228 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.413825 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:43.413841 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:43.415248 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:43.417317 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:43.417322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:43.417336 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:43.417598 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:43.417893 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:43.417897 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:43.417899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:43.418042 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:43.418439 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:43.418445 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:43.418683 (+ 238us) client_negotiation.cc:769] Sending connection context
0810 01:36:43.418870 (+ 187us) client_negotiation.cc:240] Negotiation successful
0810 01:36:43.419165 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":110,"threads_started":1}
I20260810 01:36:43.421073 25965 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41791
I20260810 01:36:43.421322 25965 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:43.421802 25965 heartbeater.cc:511] Master 127.24.205.190:41791 requested a full tablet report, sending...
I20260810 01:36:43.423209 25477 ts_manager.cc:194] Registered new tserver with Master: c61888c9640040cba7fa1173617af8b9 (127.24.205.130:43539)
I20260810 01:36:43.423872 25477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:60249
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:36:43.446579 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41791
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:37447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:43.564213 25970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:43.564481 25970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:43.564556 25970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:43.568519 25970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:43.568574 25970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:43.568674 25970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:36:43.573896 25970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:43.574986 25970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:43.576037 25970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:43.585774 25981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:43.585995 25970 server_base.cc:1034] running on GCE node
W20260810 01:36:43.585808 25980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:43.585783 25985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:43.586524 25970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:43.587086 25970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:43.588243 25970 hybrid_clock.cc:648] HybridClock initialized: now 1786325803588221 us; error 35 us; skew 500 ppm
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:43.591135 25970 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:36:43.591923 25970 webserver.cc:460] Webserver started at http://127.24.205.131:40981/ using document root <none> and password file <none>
I20260810 01:36:43.592504 25970 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:43.592566 25970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:43.592753 25970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:43.594857 25970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "e63a5f149652403cbcf2b5a3a169f316"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "849d41a3dd760c55998edda03d486431"
server_key_iv: "ebb6f4f615c8661574ef0e9dc7bb3f21"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.595439 25970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "e63a5f149652403cbcf2b5a3a169f316"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "849d41a3dd760c55998edda03d486431"
server_key_iv: "ebb6f4f615c8661574ef0e9dc7bb3f21"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.599289 25970 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:36:43.601698 25994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.602882 25970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:36:43.603016 25970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "e63a5f149652403cbcf2b5a3a169f316"
format_stamp: "Formatted at 2026-08-10 01:36:43 on dist-test-slave-t3q3"
server_key: "849d41a3dd760c55998edda03d486431"
server_key_iv: "ebb6f4f615c8661574ef0e9dc7bb3f21"
server_key_version: "encryptionkey@0"
I20260810 01:36:43.603147 25970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:43.626209 25970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:43.629427 25970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:43.629649 25970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:43.630283 25970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:43.631242 25970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:43.631315 25970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.631392 25970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:43.631444 25970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:43.643400 25970 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:43445
I20260810 01:36:43.643425 26179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:43445 every 8 connection(s)
I20260810 01:36:43.644415 25970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:43.654258 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25970
I20260810 01:36:43.654405 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:36:43.654757 25398 external_mini_cluster.cc:1428] Setting key aeb76b89f75c267fb3a4f78a17624e1b
I20260810 01:36:43.658493 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.646388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:48837 (local address 127.24.205.190:41791)
0810 01:36:43.646530 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:43.646533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:43.647565 (+ 1032us) server_negotiation.cc:407] Connection header received
0810 01:36:43.648535 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:43.648538 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:43.648584 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:43.648657 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:43.649836 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.650369 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.651491 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.651712 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.651793 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.654391 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:43.654395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:43.654398 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:43.654428 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:43.656206 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.656873 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.656876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.656878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.656971 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.657392 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.657395 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.657396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.657638 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:43.657723 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:43.658283 (+ 560us) server_negotiation.cc:299] Negotiation successful
0810 01:36:43.658379 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:36:43.659381 26187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.646776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41791 (local address 127.24.205.131:48837)
0810 01:36:43.647442 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:43.647482 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:43.648345 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:43.648826 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:43.648833 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:43.649229 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:43.649710 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:43.649722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.650474 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.650476 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:43.651372 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:43.651380 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.651850 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.651852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:43.652004 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.652714 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:43.652730 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:43.654214 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:43.656333 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:43.656338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:43.656350 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:43.656747 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:43.657090 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:43.657093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:43.657095 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:43.657280 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:43.657769 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:43.657776 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:43.658073 (+ 297us) client_negotiation.cc:769] Sending connection context
0810 01:36:43.658237 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 01:36:43.658486 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":130,"threads_started":1}
I20260810 01:36:43.660475 26180 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41791
I20260810 01:36:43.660727 26180 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:43.661203 26180 heartbeater.cc:511] Master 127.24.205.190:41791 requested a full tablet report, sending...
I20260810 01:36:43.662173 25477 ts_manager.cc:194] Registered new tserver with Master: e63a5f149652403cbcf2b5a3a169f316 (127.24.205.131:43445)
I20260810 01:36:43.662671 25477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:48837
I20260810 01:36:43.669543 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:36:43.698904 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.689734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58034 (local address 127.24.205.129:41443)
0810 01:36:43.690068 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:43.690074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:43.690100 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:36:43.690245 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:43.690251 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:43.690440 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:43.690561 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:43.691210 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.691964 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.692867 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.693251 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.693340 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.695674 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:43.695684 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:43.695696 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:43.695721 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:43.697310 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.697690 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.697694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.697695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.697777 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.698007 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.698010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.698011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.698248 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:43.698401 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:43.698547 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 01:36:43.698706 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":137,"threads_started":1}
W20260810 01:36:43.699945 25635 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58034
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[25409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:36:43.729915 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:43.721063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58046 (local address 127.24.205.129:41443)
0810 01:36:43.721207 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:43.721210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:43.721433 (+ 223us) server_negotiation.cc:407] Connection header received
0810 01:36:43.721545 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:43.721548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:43.721597 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:43.721665 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:43.722363 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.722889 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.723685 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:43.723900 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:43.723979 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:43.726528 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:43.726532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:43.726534 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:43.726558 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:43.728188 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.728661 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.728665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.728666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.728751 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:43.729035 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:43.729039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:43.729041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:43.729223 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:43.729364 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:43.729622 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 01:36:43.729747 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:36:43.731106 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25577
I20260810 01:36:43.748835 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25770
I20260810 01:36:43.762796 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25970
I20260810 01:36:43.780323 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25425
2026-08-10T01:36:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2644 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[26209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[26209](info): set up 2 sockets
Aug 10 01:36:43 dist-test-slave-t3q3 krb5kdc[26209](info): commencing operation
krb5kdc: starting...
W20260810 01:36:45.044826 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:36:45 dist-test-slave-t3q3 krb5kdc[26209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:36:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:36:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:36:45.179010 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44577
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:44577
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:45.297334 26228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:45.297639 26228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:45.297719 26228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:45.301757 26228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:36:45.301836 26228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:45.301873 26228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:45.301932 26228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:36:45.301973 26228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:36:45.307260 26228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:44577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:45.308384 26228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:45.309437 26228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:45.317967 26238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:45.317991 26239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:45.317976 26241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:45.318181 26228 server_base.cc:1034] running on GCE node
I20260810 01:36:45.318840 26228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:45.319893 26228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:45.321089 26228 hybrid_clock.cc:648] HybridClock initialized: now 1786325805321077 us; error 48 us; skew 500 ppm
Aug 10 01:36:45 dist-test-slave-t3q3 krb5kdc[26209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:45.323835 26228 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:36:45.324733 26228 webserver.cc:460] Webserver started at http://127.24.205.190:45721/ using document root <none> and password file <none>
I20260810 01:36:45.325255 26228 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:45.325318 26228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:45.325479 26228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:45.327437 26228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "c8f54f7083e146d5b69f6ba404efb853"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "62a9573a3b847f9d614a8c159e51610d"
server_key_iv: "72281a4df121a116ad1fae24b7563247"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.327965 26228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "c8f54f7083e146d5b69f6ba404efb853"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "62a9573a3b847f9d614a8c159e51610d"
server_key_iv: "72281a4df121a116ad1fae24b7563247"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.331748 26228 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:45.334245 26249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:45.335569 26228 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 01:36:45.335706 26228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "c8f54f7083e146d5b69f6ba404efb853"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "62a9573a3b847f9d614a8c159e51610d"
server_key_iv: "72281a4df121a116ad1fae24b7563247"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.335826 26228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:45.350957 26228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:45.354008 26228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:45.354216 26228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:45.361621 26228 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:44577
I20260810 01:36:45.361639 26330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:44577 every 8 connection(s)
I20260810 01:36:45.362602 26228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:36:45.365574 26331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:45.366761 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26228
I20260810 01:36:45.366863 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:36:45.367129 25398 external_mini_cluster.cc:1428] Setting key 48837d1011ae55b74b60a63fb47b4b27
I20260810 01:36:45.371518 26331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853: Bootstrap starting.
I20260810 01:36:45.373767 26331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:45.374652 26331 log.cc:824] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:36:45 dist-test-slave-t3q3 krb5kdc[26209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:45.376624 26331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853: No bootstrap required, opened a new log
I20260810 01:36:45.380434 26331 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f54f7083e146d5b69f6ba404efb853" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44577 } }
I20260810 01:36:45.380772 26331 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:45.380856 26331 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f54f7083e146d5b69f6ba404efb853, State: Initialized, Role: FOLLOWER
I20260810 01:36:45.381310 26331 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f54f7083e146d5b69f6ba404efb853" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44577 } }
I20260810 01:36:45.381464 26331 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:36:45.381556 26331 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:36:45.381676 26331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:45.381652 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:45.368619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53714 (local address 127.24.205.190:44577)
0810 01:36:45.369088 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:45.369105 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:45.369142 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:36:45.369768 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:45.369785 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:45.370112 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:45.370447 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:45.371256 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.372375 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.373259 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.373738 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.373920 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:45.376598 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:45.376604 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:45.376617 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:45.376644 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:45.378472 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:45.378977 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:45.378982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:45.378987 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:45.379103 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:45.379399 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:45.379403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:45.379405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:45.379806 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:45.380034 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:45.380394 (+ 360us) server_negotiation.cc:299] Negotiation successful
0810 01:36:45.380680 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":128,"threads_started":1}
I20260810 01:36:45.382900 26331 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f54f7083e146d5b69f6ba404efb853" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44577 } }
I20260810 01:36:45.383257 26331 leader_election.cc:302] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8f54f7083e146d5b69f6ba404efb853; no voters:
I20260810 01:36:45.383612 26331 leader_election.cc:288] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:36:45.383702 26338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:45.383889 26338 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [term 1 LEADER]: Becoming Leader. State: Replica: c8f54f7083e146d5b69f6ba404efb853, State: Running, Role: LEADER
I20260810 01:36:45.384979 26331 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:36:45.384950 26338 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f54f7083e146d5b69f6ba404efb853" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44577 } }
I20260810 01:36:45.386831 26341 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8f54f7083e146d5b69f6ba404efb853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f54f7083e146d5b69f6ba404efb853" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44577 } } }
I20260810 01:36:45.387003 26341 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [sys.catalog]: This master's current role is: LEADER
I20260810 01:36:45.387537 26340 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8f54f7083e146d5b69f6ba404efb853. Latest consensus state: current_term: 1 leader_uuid: "c8f54f7083e146d5b69f6ba404efb853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f54f7083e146d5b69f6ba404efb853" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44577 } } }
I20260810 01:36:45.387681 26340 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853 [sys.catalog]: This master's current role is: LEADER
W20260810 01:36:45.390018 26357 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:36:45.390086 26357 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:36:45.390208 26358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:36:45.391146 26358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:36:45.397055 26358 catalog_manager.cc:1347] Generated new cluster ID: eb0270832a904c29888e9ae55059d00f
I20260810 01:36:45.397126 26358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:36:45.414029 26358 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:36:45.415328 26358 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:36:45.430605 26358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8f54f7083e146d5b69f6ba404efb853: Generated new TSK 0
I20260810 01:36:45.431378 26358 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:36:45.461323 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44577
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:45.577981 26368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:45.578226 26368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:45.578272 26368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:45.582242 26368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:45.582296 26368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:45.582391 26368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:36:45.588114 26368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44577
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:45.589154 26368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:45.590165 26368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:45.600317 26380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:45.600339 26377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:45.600355 26376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:45.600545 26368 server_base.cc:1034] running on GCE node
I20260810 01:36:45.601176 26368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:45.601850 26368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:45.603044 26368 hybrid_clock.cc:648] HybridClock initialized: now 1786325805603013 us; error 42 us; skew 500 ppm
Aug 10 01:36:45 dist-test-slave-t3q3 krb5kdc[26209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:45.606063 26368 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:36:45.606958 26368 webserver.cc:460] Webserver started at http://127.24.205.129:45075/ using document root <none> and password file <none>
I20260810 01:36:45.607563 26368 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:45.607661 26368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:45.607932 26368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:45.610136 26368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "2098879d8b5e46e3a294f164db4d8857"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "1bffea8afe08a937674bfd4845c47b73"
server_key_iv: "bbc286f4994ee1fbb930cd0ad84e0ec2"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.610725 26368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "2098879d8b5e46e3a294f164db4d8857"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "1bffea8afe08a937674bfd4845c47b73"
server_key_iv: "bbc286f4994ee1fbb930cd0ad84e0ec2"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.614565 26368 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:36:45.617137 26394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:45.618562 26368 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:36:45.618710 26368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "2098879d8b5e46e3a294f164db4d8857"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "1bffea8afe08a937674bfd4845c47b73"
server_key_iv: "bbc286f4994ee1fbb930cd0ad84e0ec2"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.618829 26368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:45.631982 26368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:45.635568 26368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:45.635766 26368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:45.636497 26368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:45.637322 26368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:45.637369 26368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:45.637408 26368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:45.637424 26368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:45.646239 26368 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:33751
I20260810 01:36:45.646327 26572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:33751 every 8 connection(s)
I20260810 01:36:45.647220 26368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:36:45.648748 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26368
I20260810 01:36:45.648867 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:36:45.649190 25398 external_mini_cluster.cc:1428] Setting key 31d5c0a0d422831d4d61d7626fee5159
Aug 10 01:36:45 dist-test-slave-t3q3 krb5kdc[26209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:36:45.662184 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:45.649304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:59609 (local address 127.24.205.190:44577)
0810 01:36:45.649457 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:45.649462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:45.650441 (+ 979us) server_negotiation.cc:407] Connection header received
0810 01:36:45.651591 (+ 1150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:45.651594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:45.651639 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:45.651712 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:45.653423 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.653973 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.655178 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.655420 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.655538 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:45.658440 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:45.658444 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:45.658449 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:45.658478 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:45.659974 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:45.660515 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:45.660519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:45.660522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:45.660606 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:45.660963 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:45.660966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:45.660967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:45.661239 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:45.661356 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:45.661868 (+ 512us) server_negotiation.cc:299] Negotiation successful
0810 01:36:45.661999 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
I20260810 01:36:45.663188 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:45.649769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44577 (local address 127.24.205.129:59609)
0810 01:36:45.650289 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:45.650330 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:45.651346 (+ 1016us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:45.651899 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:45.651911 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:45.652482 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:45.653242 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:45.653265 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.654108 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.654112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:45.655039 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:45.655049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.655581 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.655585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:45.655809 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:45.656485 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:45.656502 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:45.658270 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:45.660111 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:45.660118 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:45.660136 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:45.660407 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:45.660701 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:45.660705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:45.660707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:45.660852 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:45.661354 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:45.661361 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:45.661611 (+ 250us) client_negotiation.cc:769] Sending connection context
0810 01:36:45.661808 (+ 197us) client_negotiation.cc:240] Negotiation successful
0810 01:36:45.662153 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":172,"threads_started":1}
I20260810 01:36:45.664587 26573 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44577
I20260810 01:36:45.664875 26573 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:45.665493 26573 heartbeater.cc:511] Master 127.24.205.190:44577 requested a full tablet report, sending...
I20260810 01:36:45.667366 26277 ts_manager.cc:194] Registered new tserver with Master: 2098879d8b5e46e3a294f164db4d8857 (127.24.205.129:33751)
I20260810 01:36:45.669152 26277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:59609
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:36:45.679272 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44577
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:45.795403 26582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:45.795661 26582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:45.795742 26582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:45.799819 26582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:45.799889 26582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:45.799948 26582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:36:45.805804 26582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44577
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:45.806866 26582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:45.807888 26582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:45.817670 26589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:45.817672 26594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:45.817888 26582 server_base.cc:1034] running on GCE node
W20260810 01:36:45.817687 26588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:45.818395 26582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:45.819020 26582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:45.820199 26582 hybrid_clock.cc:648] HybridClock initialized: now 1786325805820159 us; error 47 us; skew 500 ppm
Aug 10 01:36:45 dist-test-slave-t3q3 krb5kdc[26209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:45.823117 26582 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:36:45.824015 26582 webserver.cc:460] Webserver started at http://127.24.205.130:39879/ using document root <none> and password file <none>
I20260810 01:36:45.824638 26582 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:45.824746 26582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:45.824987 26582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:45.827042 26582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "5432733e570bb376f0acad7d07713b7f"
server_key_iv: "ba0543fe7a7a9e52d47cc45af3188197"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.827632 26582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "5432733e570bb376f0acad7d07713b7f"
server_key_iv: "ba0543fe7a7a9e52d47cc45af3188197"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.831420 26582 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 01:36:45.833962 26609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:45.835309 26582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 01:36:45.835453 26582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742"
format_stamp: "Formatted at 2026-08-10 01:36:45 on dist-test-slave-t3q3"
server_key: "5432733e570bb376f0acad7d07713b7f"
server_key_iv: "ba0543fe7a7a9e52d47cc45af3188197"
server_key_version: "encryptionkey@0"
I20260810 01:36:45.835599 26582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:45.851024 26582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:45.854090 26582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:45.854298 26582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:45.854893 26582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:45.855724 26582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:45.855795 26582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:45.855901 26582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:45.855953 26582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:45.864987 26582 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:43973
I20260810 01:36:45.865024 26800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:43973 every 8 connection(s)
I20260810 01:36:45.865914 26582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:36:45.866480 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26582
I20260810 01:36:45.866613 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:36:45.866884 25398 external_mini_cluster.cc:1428] Setting key 7e1859147d21995cda8687572d5b1155
Aug 10 01:36:45 dist-test-slave-t3q3 krb5kdc[26209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:36:45.880941 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:45.867771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:43769 (local address 127.24.205.190:44577)
0810 01:36:45.867915 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:45.867919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:45.869008 (+ 1089us) server_negotiation.cc:407] Connection header received
0810 01:36:45.870059 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:45.870065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:45.870128 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:45.870228 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:45.871868 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.872486 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.873682 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.874133 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.874275 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:45.876882 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:45.876890 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:45.876896 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:45.876931 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:45.878624 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:45.879163 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:45.879166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:45.879167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:45.879253 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:45.879632 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:45.879637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:45.879639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:45.879841 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:45.879956 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:45.880579 (+ 623us) server_negotiation.cc:299] Negotiation successful
0810 01:36:45.880716 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:36:45.881983 26803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:45.868277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44577 (local address 127.24.205.130:43769)
0810 01:36:45.868810 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:45.868879 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:45.869856 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:45.870420 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:45.870430 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:45.870967 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:45.871698 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:45.871725 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.872602 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.872605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:45.873547 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:45.873556 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:45.874322 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:45.874325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:45.874467 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:45.875084 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:45.875100 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:45.876697 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:45.878792 (+ 2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:45.878797 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:45.878808 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:45.879061 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:45.879340 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:45.879342 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:45.879343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:45.879509 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:45.879956 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:45.879962 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:45.880272 (+ 310us) client_negotiation.cc:769] Sending connection context
0810 01:36:45.880497 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 01:36:45.880836 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":141,"threads_started":1}
I20260810 01:36:45.883273 26801 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44577
I20260810 01:36:45.883567 26801 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:45.884228 26801 heartbeater.cc:511] Master 127.24.205.190:44577 requested a full tablet report, sending...
I20260810 01:36:45.885494 26277 ts_manager.cc:194] Registered new tserver with Master: 3cbfdbcfc67d40d6bd2e89af44f6e742 (127.24.205.130:43973)
I20260810 01:36:45.886195 26277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:43769
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:36:45.898514 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44577
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:46.015019 26809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:46.015283 26809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:46.015328 26809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:46.019366 26809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:46.019431 26809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:46.019491 26809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:36:46.024895 26809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44577
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:46.025916 26809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:46.026924 26809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:46.036651 26826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:46.036653 26815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:46.036892 26809 server_base.cc:1034] running on GCE node
W20260810 01:36:46.037026 26829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:46.037484 26809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:46.038141 26809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:46.039306 26809 hybrid_clock.cc:648] HybridClock initialized: now 1786325806039290 us; error 28 us; skew 500 ppm
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[26209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325806, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:46.042289 26809 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:36:46.043185 26809 webserver.cc:460] Webserver started at http://127.24.205.131:35095/ using document root <none> and password file <none>
I20260810 01:36:46.043772 26809 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:46.043867 26809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:46.044158 26809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:46.046229 26809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "616b598c53854750873f202769ade6b0"
format_stamp: "Formatted at 2026-08-10 01:36:46 on dist-test-slave-t3q3"
server_key: "40493dd971df88e832d5274bef739041"
server_key_iv: "0be78a803b568409d80947461a2496df"
server_key_version: "encryptionkey@0"
I20260810 01:36:46.046818 26809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "616b598c53854750873f202769ade6b0"
format_stamp: "Formatted at 2026-08-10 01:36:46 on dist-test-slave-t3q3"
server_key: "40493dd971df88e832d5274bef739041"
server_key_iv: "0be78a803b568409d80947461a2496df"
server_key_version: "encryptionkey@0"
I20260810 01:36:46.050596 26809 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:36:46.053159 26843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:46.054339 26809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:36:46.054479 26809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "616b598c53854750873f202769ade6b0"
format_stamp: "Formatted at 2026-08-10 01:36:46 on dist-test-slave-t3q3"
server_key: "40493dd971df88e832d5274bef739041"
server_key_iv: "0be78a803b568409d80947461a2496df"
server_key_version: "encryptionkey@0"
I20260810 01:36:46.054600 26809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:46.074087 26809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:46.077124 26809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:46.077348 26809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:46.077960 26809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:46.078817 26809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:46.078902 26809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:46.078980 26809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:46.079035 26809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:46.088840 26809 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:45077
I20260810 01:36:46.088874 27018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:45077 every 8 connection(s)
I20260810 01:36:46.089762 26809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:36:46.095546 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26809
I20260810 01:36:46.095676 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:36:46.095968 25398 external_mini_cluster.cc:1428] Setting key 6a6317f35bf5a2c218ff0d61c559ba6b
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[26209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325806, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:46.103348 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.091627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:50235 (local address 127.24.205.190:44577)
0810 01:36:46.091775 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.091779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.092697 (+ 918us) server_negotiation.cc:407] Connection header received
0810 01:36:46.093633 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.093637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.093695 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.093810 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:46.094983 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.095730 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.097181 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.097406 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.097532 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.099943 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:46.099945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:46.099947 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:46.099969 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:46.101554 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.102041 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.102044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.102045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.102132 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.102448 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.102450 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.102452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.102626 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:46.102705 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.103134 (+ 429us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.103232 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:36:46.104243 27027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.091998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44577 (local address 127.24.205.131:50235)
0810 01:36:46.092545 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:46.092589 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:46.093411 (+ 822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:46.093991 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:46.093998 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:46.094356 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:46.094832 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.094846 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.095864 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.095867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.097051 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.097062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.097585 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.097588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.097739 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.098329 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:46.098345 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:46.099773 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:46.101654 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:46.101659 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:46.101670 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:46.101920 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:46.102229 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:46.102231 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:46.102233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:46.102364 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:46.102716 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:46.102721 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:46.102932 (+ 211us) client_negotiation.cc:769] Sending connection context
0810 01:36:46.103080 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 01:36:46.103331 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":120,"threads_started":1}
I20260810 01:36:46.105479 27020 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44577
I20260810 01:36:46.105739 27020 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:46.106212 27020 heartbeater.cc:511] Master 127.24.205.190:44577 requested a full tablet report, sending...
I20260810 01:36:46.107280 26277 ts_manager.cc:194] Registered new tserver with Master: 616b598c53854750873f202769ade6b0 (127.24.205.131:45077)
I20260810 01:36:46.107859 26277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:50235
I20260810 01:36:46.109938 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:36:46.121637 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.114045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53716 (local address 127.24.205.190:44577)
0810 01:36:46.114200 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.114205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.114385 (+ 180us) server_negotiation.cc:407] Connection header received
0810 01:36:46.114544 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.114547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.114593 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.114684 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:46.115380 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.115888 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.116779 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.116995 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.117106 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.118466 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:46.118471 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:46.118473 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:46.118498 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:46.119928 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.120390 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.120394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.120396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.120479 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.120764 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.120767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.120769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.120981 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:46.121124 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.121362 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.121474 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:36:46.127453 26277 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:36:46.130908 26277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:46.146821 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.140646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:43973 (local address 127.0.0.1:42768)
0810 01:36:46.141176 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:46.141227 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:46.141365 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:46.142483 (+ 1118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:46.142490 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:46.142513 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:46.142649 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.142655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.144203 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.144206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.145409 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.145419 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.146242 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.146246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.146377 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.146420 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 01:36:46.146546 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 01:36:46.146675 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":30,"thread_start_us":93,"threads_started":1}
I20260810 01:36:46.146834 27046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.141336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42768 (local address 127.24.205.130:43973)
0810 01:36:46.142072 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.142084 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.142104 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:36:46.142168 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.142172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.142342 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.142472 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:46.142787 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.144042 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.145534 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.146108 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.146261 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.146465 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.146576 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.146670 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":129,"threads_started":1}
I20260810 01:36:46.147153 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.141337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:45077 (local address 127.0.0.1:35372)
0810 01:36:46.141690 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:46.141704 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:46.141804 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:46.142828 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:46.142831 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:46.142848 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:46.142938 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.142944 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.143920 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.143924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.145431 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.145442 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.146734 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.146738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.146825 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.146847 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:36:46.146920 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:36:46.146996 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":33,"spinlock_wait_cycles":4224,"thread_start_us":122,"threads_started":1}
I20260810 01:36:46.147662 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.141846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35372 (local address 127.24.205.131:45077)
0810 01:36:46.142331 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.142344 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.142421 (+ 77us) server_negotiation.cc:407] Connection header received
0810 01:36:46.142494 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.142500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.142705 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.142856 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:46.143055 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.143785 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.145587 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.146442 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.146553 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.146670 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.147412 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.147511 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":178,"threads_started":1}
I20260810 01:36:46.147897 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.140762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:33751 (local address 127.0.0.1:60510)
0810 01:36:46.141676 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:46.141690 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:46.141804 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:46.142601 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:46.142604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:46.142624 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:46.142755 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.142764 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.145058 (+ 2294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.145062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.146159 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.146170 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.147474 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.147477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.147578 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.147600 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:36:46.147689 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 01:36:46.147776 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":848,"spinlock_wait_cycles":7552,"thread_start_us":135,"threads_started":1}
I20260810 01:36:46.148027 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.140933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.24.205.129:33751)
0810 01:36:46.141406 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.141426 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.141919 (+ 493us) server_negotiation.cc:407] Connection header received
0810 01:36:46.142011 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.142017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.142231 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.142397 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:46.142898 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.144041 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.146314 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.147148 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.147284 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.147412 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.147752 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.147859 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":103,"threads_started":1}
I20260810 01:36:46.150565 26910 tablet_service.cc:1467] Processing CreateTablet for tablet 53831771796d41dcacf34818d8925d3c (DEFAULT_TABLE table=test-table [id=6d055a8a64d04467ba0014df2e6c0d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:46.150755 26470 tablet_service.cc:1467] Processing CreateTablet for tablet 53831771796d41dcacf34818d8925d3c (DEFAULT_TABLE table=test-table [id=6d055a8a64d04467ba0014df2e6c0d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:46.151759 26470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53831771796d41dcacf34818d8925d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:46.151820 26910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53831771796d41dcacf34818d8925d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:46.152647 26686 tablet_service.cc:1467] Processing CreateTablet for tablet 53831771796d41dcacf34818d8925d3c (DEFAULT_TABLE table=test-table [id=6d055a8a64d04467ba0014df2e6c0d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:46.154016 26686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53831771796d41dcacf34818d8925d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:46.158581 27051 tablet_bootstrap.cc:492] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857: Bootstrap starting.
I20260810 01:36:46.161172 27051 tablet_bootstrap.cc:654] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:46.161197 27053 tablet_bootstrap.cc:492] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742: Bootstrap starting.
I20260810 01:36:46.161767 27052 tablet_bootstrap.cc:492] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0: Bootstrap starting.
I20260810 01:36:46.162626 27051 log.cc:824] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:46.163898 27053 tablet_bootstrap.cc:654] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:46.164091 27052 tablet_bootstrap.cc:654] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:46.164641 27051 tablet_bootstrap.cc:492] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857: No bootstrap required, opened a new log
I20260810 01:36:46.164851 27051 ts_tablet_manager.cc:1397] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:36:46.164912 27053 log.cc:824] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:46.165288 27052 log.cc:824] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:46.166915 27053 tablet_bootstrap.cc:492] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742: No bootstrap required, opened a new log
I20260810 01:36:46.167120 27053 ts_tablet_manager.cc:1397] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:36:46.167433 27052 tablet_bootstrap.cc:492] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0: No bootstrap required, opened a new log
I20260810 01:36:46.167629 27052 ts_tablet_manager.cc:1397] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:36:46.168800 27051 raft_consensus.cc:348] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.169086 27051 raft_consensus.cc:374] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:46.169188 27051 raft_consensus.cc:729] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2098879d8b5e46e3a294f164db4d8857, State: Initialized, Role: FOLLOWER
I20260810 01:36:46.169672 27051 consensus_queue.cc:260] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.170424 26573 heartbeater.cc:503] Master 127.24.205.190:44577 was elected leader, sending a full tablet report...
I20260810 01:36:46.170948 27052 raft_consensus.cc:348] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.170935 27053 raft_consensus.cc:348] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.171195 27052 raft_consensus.cc:374] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:46.171250 27052 raft_consensus.cc:729] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616b598c53854750873f202769ade6b0, State: Initialized, Role: FOLLOWER
I20260810 01:36:46.171307 27053 raft_consensus.cc:374] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:46.171381 27053 raft_consensus.cc:729] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cbfdbcfc67d40d6bd2e89af44f6e742, State: Initialized, Role: FOLLOWER
I20260810 01:36:46.171687 27052 consensus_queue.cc:260] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.171794 27053 consensus_queue.cc:260] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.172279 27051 ts_tablet_manager.cc:1428] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:36:46.172807 27052 ts_tablet_manager.cc:1428] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:36:46.172851 27053 ts_tablet_manager.cc:1428] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 01:36:46.172902 27020 heartbeater.cc:503] Master 127.24.205.190:44577 was elected leader, sending a full tablet report...
I20260810 01:36:46.173300 26801 heartbeater.cc:503] Master 127.24.205.190:44577 was elected leader, sending a full tablet report...
I20260810 01:36:46.174153 27067 raft_consensus.cc:482] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:46.174322 27067 raft_consensus.cc:504] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.176299 27067 leader_election.cc:288] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cbfdbcfc67d40d6bd2e89af44f6e742 (127.24.205.130:43973), 2098879d8b5e46e3a294f164db4d8857 (127.24.205.129:33751)
I20260810 01:36:46.179766 27027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.175676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:43973 (local address 127.24.205.131:33511)
0810 01:36:46.175792 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:46.175810 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:46.175898 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:46.176386 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:46.176392 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:46.176415 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:46.176549 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.176557 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.177417 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.177420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.178602 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.178613 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.179439 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.179441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.179527 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.179555 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 01:36:46.179616 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 01:36:46.179670 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 01:36:46.179837 27046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.175763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:33511 (local address 127.24.205.130:43973)
0810 01:36:46.175872 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.175877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.175890 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:36:46.175991 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.175995 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.176040 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.176145 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:46.176656 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.177291 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.178726 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.179315 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.179444 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.179497 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.179654 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.179726 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:36:46.180518 26715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53831771796d41dcacf34818d8925d3c" candidate_uuid: "616b598c53854750873f202769ade6b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" is_pre_election: true
I20260810 01:36:46.180923 26715 raft_consensus.cc:2454] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616b598c53854750873f202769ade6b0 in term 0.
I20260810 01:36:46.181474 27069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.176041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:33751 (local address 127.24.205.131:55567)
0810 01:36:46.177363 (+ 1322us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:46.177378 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:46.177595 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:46.177963 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:46.177967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:46.177987 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:46.178113 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.178119 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.178973 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.178976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.180126 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:46.180138 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.181048 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.181051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:46.181132 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.181151 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:36:46.181251 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 01:36:46.181337 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1256,"thread_start_us":105,"threads_started":1}
I20260810 01:36:46.181521 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.176294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:55567 (local address 127.24.205.129:33751)
0810 01:36:46.176427 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.176431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.177578 (+ 1147us) server_negotiation.cc:407] Connection header received
0810 01:36:46.177698 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.177701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.177747 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.177828 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:46.178223 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.178869 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.180263 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.180913 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.181048 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.181111 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.181299 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.181394 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:36:46.181562 26846 leader_election.cc:302] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cbfdbcfc67d40d6bd2e89af44f6e742, 616b598c53854750873f202769ade6b0; no voters:
I20260810 01:36:46.181844 27067 raft_consensus.cc:2781] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:46.181951 27067 raft_consensus.cc:482] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:46.182008 27067 raft_consensus.cc:3037] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:46.182078 26501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53831771796d41dcacf34818d8925d3c" candidate_uuid: "616b598c53854750873f202769ade6b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2098879d8b5e46e3a294f164db4d8857" is_pre_election: true
I20260810 01:36:46.182344 26501 raft_consensus.cc:2454] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616b598c53854750873f202769ade6b0 in term 0.
I20260810 01:36:46.183358 27067 raft_consensus.cc:504] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.183749 27067 leader_election.cc:288] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [CANDIDATE]: Term 1 election: Requested vote from peers 3cbfdbcfc67d40d6bd2e89af44f6e742 (127.24.205.130:43973), 2098879d8b5e46e3a294f164db4d8857 (127.24.205.129:33751)
I20260810 01:36:46.184118 26715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53831771796d41dcacf34818d8925d3c" candidate_uuid: "616b598c53854750873f202769ade6b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742"
I20260810 01:36:46.184176 26501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53831771796d41dcacf34818d8925d3c" candidate_uuid: "616b598c53854750873f202769ade6b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2098879d8b5e46e3a294f164db4d8857"
I20260810 01:36:46.184230 26715 raft_consensus.cc:3037] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:46.184314 26501 raft_consensus.cc:3037] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:46.185387 26501 raft_consensus.cc:2454] T 53831771796d41dcacf34818d8925d3c P 2098879d8b5e46e3a294f164db4d8857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616b598c53854750873f202769ade6b0 in term 1.
I20260810 01:36:46.185398 26715 raft_consensus.cc:2454] T 53831771796d41dcacf34818d8925d3c P 3cbfdbcfc67d40d6bd2e89af44f6e742 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616b598c53854750873f202769ade6b0 in term 1.
I20260810 01:36:46.185707 26846 leader_election.cc:302] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2098879d8b5e46e3a294f164db4d8857, 3cbfdbcfc67d40d6bd2e89af44f6e742, 616b598c53854750873f202769ade6b0; no voters:
I20260810 01:36:46.185916 27067 raft_consensus.cc:2781] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:46.186188 27067 raft_consensus.cc:686] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [term 1 LEADER]: Becoming Leader. State: Replica: 616b598c53854750873f202769ade6b0, State: Running, Role: LEADER
I20260810 01:36:46.186509 27067 consensus_queue.cc:237] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } }
I20260810 01:36:46.189790 26277 catalog_manager.cc:5495] T 53831771796d41dcacf34818d8925d3c P 616b598c53854750873f202769ade6b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 616b598c53854750873f202769ade6b0 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "616b598c53854750873f202769ade6b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cbfdbcfc67d40d6bd2e89af44f6e742" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 43973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2098879d8b5e46e3a294f164db4d8857" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616b598c53854750873f202769ade6b0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 45077 } health_report { overall_health: HEALTHY } } }
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[26209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:36:46.204308 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.195569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60518 (local address 127.24.205.129:33751)
0810 01:36:46.195697 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.195700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.195895 (+ 195us) server_negotiation.cc:407] Connection header received
0810 01:36:46.196003 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.196005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.196043 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.196172 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:46.196802 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.197351 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.198158 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.198359 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.198433 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.200967 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:46.200976 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:46.200990 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:46.201012 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:46.202618 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.203089 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.203094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.203095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.203177 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.203423 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.203425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.203427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.203674 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:46.203837 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.204033 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.204191 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[26209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325806, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[26209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325806, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:36:46.238289 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.224975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60530 (local address 127.24.205.129:33751)
0810 01:36:46.225171 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.225175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.225236 (+ 61us) server_negotiation.cc:407] Connection header received
0810 01:36:46.225370 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.225373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.225418 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.225489 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:46.226134 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.226663 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.227452 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.227686 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.227767 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.234817 (+ 7050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:46.234829 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:46.234831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:46.234860 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:46.236469 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.236929 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.236932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.236933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.237019 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.237280 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.237282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.237283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.237457 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:46.237571 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.237926 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.238096 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[26209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[26209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:36:46.266960 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:46.257961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60544 (local address 127.24.205.129:33751)
0810 01:36:46.258147 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:46.258152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:46.258290 (+ 138us) server_negotiation.cc:407] Connection header received
0810 01:36:46.258467 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:46.258471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:46.258522 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:46.258609 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:46.259317 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.260053 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.261042 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:46.261274 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:46.261389 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:46.263830 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:46.263834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:46.263837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:46.263870 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:46.265139 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.265680 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.265684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.265685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.265770 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:46.266093 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:46.266098 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:46.266099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:46.266270 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:46.266415 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:46.266664 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 01:36:46.266789 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260810 01:36:46.268728 26440 tablet_service.cc:2908] Rejecting scan request for tablet 53831771796d41dcacf34818d8925d3c: Uninitialized: clean time has not yet been initialized
I20260810 01:36:46.271143 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26368
I20260810 01:36:46.291043 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26582
I20260810 01:36:46.309423 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26809
I20260810 01:36:46.320605 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26228
2026-08-10T01:36:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2539 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[27097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[27097](info): set up 2 sockets
Aug 10 01:36:46 dist-test-slave-t3q3 krb5kdc[27097](info): commencing operation
krb5kdc: starting...
W20260810 01:36:47.609057 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:36:47 dist-test-slave-t3q3 krb5kdc[27097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:36:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:36:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:36:47.744689 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38667
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:38667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:47.861567 27119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:47.861848 27119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:47.861920 27119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:47.865904 27119 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:36:47.865988 27119 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 01:36:47.866020 27119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:47.866060 27119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:47.866094 27119 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:36:47.866143 27119 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:36:47.871299 27119 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:38667
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:47.872362 27119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:47.873416 27119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:47.882041 27129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:47.882105 27131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:47.882289 27119 server_base.cc:1034] running on GCE node
W20260810 01:36:47.882041 27133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:47.883080 27119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:47.884271 27119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:47.885460 27119 hybrid_clock.cc:648] HybridClock initialized: now 1786325807885444 us; error 29 us; skew 500 ppm
Aug 10 01:36:47 dist-test-slave-t3q3 krb5kdc[27097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325807, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:47.888311 27119 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:36:47.889237 27119 webserver.cc:460] Webserver started at http://127.24.205.190:45367/ using document root <none> and password file <none>
I20260810 01:36:47.889812 27119 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:47.889904 27119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:47.890141 27119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:47.892304 27119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "c80b2991f510486a8e5bd98d67ce8403"
format_stamp: "Formatted at 2026-08-10 01:36:47 on dist-test-slave-t3q3"
server_key: "29e43fe6d28fa5feee806867c137fa0f"
server_key_iv: "0b5bf647e0755b147a3dc8584193665d"
server_key_version: "encryptionkey@0"
I20260810 01:36:47.892923 27119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "c80b2991f510486a8e5bd98d67ce8403"
format_stamp: "Formatted at 2026-08-10 01:36:47 on dist-test-slave-t3q3"
server_key: "29e43fe6d28fa5feee806867c137fa0f"
server_key_iv: "0b5bf647e0755b147a3dc8584193665d"
server_key_version: "encryptionkey@0"
I20260810 01:36:47.896668 27119 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:36:47.899132 27141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:47.900460 27119 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:36:47.900604 27119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "c80b2991f510486a8e5bd98d67ce8403"
format_stamp: "Formatted at 2026-08-10 01:36:47 on dist-test-slave-t3q3"
server_key: "29e43fe6d28fa5feee806867c137fa0f"
server_key_iv: "0b5bf647e0755b147a3dc8584193665d"
server_key_version: "encryptionkey@0"
I20260810 01:36:47.900714 27119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:47.921451 27119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:47.924515 27119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:47.924723 27119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:47.933094 27119 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:38667
I20260810 01:36:47.933109 27248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:38667 every 8 connection(s)
I20260810 01:36:47.934134 27119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:36:47.936939 27249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:47.942972 27249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: Bootstrap starting.
I20260810 01:36:47.943658 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27119
I20260810 01:36:47.943755 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:36:47.944036 25398 external_mini_cluster.cc:1428] Setting key 03ce15ccf8a58fd4c4aa424deb1dd025
I20260810 01:36:47.945957 27249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:47.946753 27249 log.cc:824] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:47.949051 27249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: No bootstrap required, opened a new log
Aug 10 01:36:47 dist-test-slave-t3q3 krb5kdc[27097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:47.954200 27249 raft_consensus.cc:348] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b2991f510486a8e5bd98d67ce8403" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38667 } }
I20260810 01:36:47.954550 27249 raft_consensus.cc:374] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:47.954635 27249 raft_consensus.cc:729] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80b2991f510486a8e5bd98d67ce8403, State: Initialized, Role: FOLLOWER
I20260810 01:36:47.955228 27249 consensus_queue.cc:260] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b2991f510486a8e5bd98d67ce8403" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38667 } }
I20260810 01:36:47.955428 27249 raft_consensus.cc:388] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:36:47.955503 27249 raft_consensus.cc:482] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:36:47.955624 27249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:47.956936 27249 raft_consensus.cc:504] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b2991f510486a8e5bd98d67ce8403" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38667 } }
I20260810 01:36:47.957347 27249 leader_election.cc:302] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c80b2991f510486a8e5bd98d67ce8403; no voters:
I20260810 01:36:47.957755 27249 leader_election.cc:288] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:36:47.957865 27259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:47.958220 27259 raft_consensus.cc:686] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [term 1 LEADER]: Becoming Leader. State: Replica: c80b2991f510486a8e5bd98d67ce8403, State: Running, Role: LEADER
I20260810 01:36:47.958629 27259 consensus_queue.cc:237] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b2991f510486a8e5bd98d67ce8403" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38667 } }
I20260810 01:36:47.959252 27249 sys_catalog.cc:564] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:36:47.960454 27260 sys_catalog.cc:455] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c80b2991f510486a8e5bd98d67ce8403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b2991f510486a8e5bd98d67ce8403" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38667 } } }
I20260810 01:36:47.960520 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:47.945386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50554 (local address 127.24.205.190:38667)
0810 01:36:47.945856 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:47.945872 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:47.945908 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:36:47.946627 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:47.946645 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:47.947039 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:47.947442 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:47.948342 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:47.949505 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:47.950705 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:47.951254 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:47.951440 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:47.954381 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:47.954387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:47.954405 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:47.954441 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:47.956675 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:47.957222 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:47.957229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:47.957235 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:47.957389 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:47.957709 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:47.957735 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:47.957736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:47.958317 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:47.958520 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:47.958886 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 01:36:47.959393 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":161,"threads_started":1}
I20260810 01:36:47.960608 27260 sys_catalog.cc:458] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [sys.catalog]: This master's current role is: LEADER
I20260810 01:36:47.960860 27260 sys_catalog.cc:455] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c80b2991f510486a8e5bd98d67ce8403. Latest consensus state: current_term: 1 leader_uuid: "c80b2991f510486a8e5bd98d67ce8403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b2991f510486a8e5bd98d67ce8403" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38667 } } }
I20260810 01:36:47.960939 27260 sys_catalog.cc:458] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403 [sys.catalog]: This master's current role is: LEADER
W20260810 01:36:47.964689 27287 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:36:47.964823 27287 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:36:47.964897 27278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:36:47.965816 27278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:36:47.971861 27278 catalog_manager.cc:1347] Generated new cluster ID: 857eb331023a4b5ba3e6f0861355a4e1
I20260810 01:36:47.971947 27278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:36:47.992002 27278 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:36:47.993463 27278 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:36:48.003189 27278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: Generated new TSK 0
I20260810 01:36:48.003935 27278 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:36:48.041550 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38667
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:48.181753 27293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:48.182029 27293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:48.182075 27293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:48.186084 27293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:48.186151 27293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:48.186190 27293 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:36:48.186262 27293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:36:48.191645 27293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:38667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:48.192759 27293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:48.193926 27293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:48.203811 27307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:48.203841 27304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:48.203910 27305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:48.204205 27293 server_base.cc:1034] running on GCE node
I20260810 01:36:48.204582 27293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:48.205202 27293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:48.206395 27293 hybrid_clock.cc:648] HybridClock initialized: now 1786325808206378 us; error 28 us; skew 500 ppm
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:48.209192 27293 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:36:48.210008 27293 webserver.cc:460] Webserver started at http://127.24.205.129:43765/ using document root <none> and password file <none>
I20260810 01:36:48.210523 27293 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:48.210580 27293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:48.210762 27293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:48.212849 27293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "93b12d94fd72422ba154bee5368dd294"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "103962840287ad5d0fbb91727fa95318"
server_key_iv: "20183e932acc14c7d2ceb6d46e4f5329"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.213387 27293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "93b12d94fd72422ba154bee5368dd294"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "103962840287ad5d0fbb91727fa95318"
server_key_iv: "20183e932acc14c7d2ceb6d46e4f5329"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.217021 27293 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:36:48.219398 27316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:48.220624 27293 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:36:48.220738 27293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "93b12d94fd72422ba154bee5368dd294"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "103962840287ad5d0fbb91727fa95318"
server_key_iv: "20183e932acc14c7d2ceb6d46e4f5329"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.220829 27293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:48.246419 27293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:48.249879 27293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:48.250094 27293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:48.251564 27293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:48.251636 27293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:48.251740 27293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:48.251796 27293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:48.263360 27293 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:36225
I20260810 01:36:48.263500 27500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:36225 every 8 connection(s)
I20260810 01:36:48.264416 27293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:36:48.266083 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.253090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:52769 (local address 127.24.205.190:38667)
0810 01:36:48.253213 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.253217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.253853 (+ 636us) server_negotiation.cc:407] Connection header received
0810 01:36:48.254927 (+ 1074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.254931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.254994 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.255101 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:48.256439 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.257359 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.258600 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.258906 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.259019 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.262246 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:48.262250 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:48.262253 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:48.262282 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:48.263934 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.264535 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.264539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.264541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.264628 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.265049 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.265055 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.265058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.265310 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:48.265413 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.265855 (+ 442us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.265965 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:36:48.266861 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.253222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38667 (local address 127.24.205.129:52769)
0810 01:36:48.253706 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.253748 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.254695 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.255333 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.255347 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.255670 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:48.256219 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.256235 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.257505 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.257508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.258467 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.258477 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.259076 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.259080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.259261 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.259887 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:48.259911 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:48.262053 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:48.264043 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.264049 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.264086 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.264433 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.264725 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.264732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.264736 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.264926 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.265416 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:48.265420 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:48.265640 (+ 220us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.265790 (+ 150us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.266031 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":140,"threads_started":1}
I20260810 01:36:48.268368 27504 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38667
I20260810 01:36:48.268507 27504 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:48.269069 27504 heartbeater.cc:511] Master 127.24.205.190:38667 requested a full tablet report, sending...
I20260810 01:36:48.270747 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27293
I20260810 01:36:48.270751 27171 ts_manager.cc:194] Registered new tserver with Master: 93b12d94fd72422ba154bee5368dd294 (127.24.205.129:36225)
I20260810 01:36:48.270875 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:36:48.271212 25398 external_mini_cluster.cc:1428] Setting key 3a1348ae28ad87772591bb5855837932
I20260810 01:36:48.272228 27171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:52769
I20260810 01:36:48.278594 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.270589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:42717 (local address 127.24.205.190:38667)
0810 01:36:48.270709 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.270713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.270973 (+ 260us) server_negotiation.cc:407] Connection header received
0810 01:36:48.271162 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.271166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.271214 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.271294 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:48.271802 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.272534 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.273620 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.274011 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.274133 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.275428 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:48.275431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:48.275433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:48.275454 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:48.276870 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.277380 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.277383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.277384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.277454 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.277770 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.277773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.277775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.277942 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:48.278018 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.278320 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.278432 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:36:48.278738 27517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.270467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38667 (local address 127.24.205.129:42717)
0810 01:36:48.270884 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.270902 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.271044 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.271337 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.271340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.271563 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:48.271686 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.271693 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.272658 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.272661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.273487 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.273498 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.274144 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.274147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.274238 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.274797 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:48.274815 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:48.275277 (+ 462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:48.276980 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.276986 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.276991 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.277275 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.277541 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.277547 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.277552 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.277665 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.278039 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:48.278042 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:48.278148 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.278270 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.278460 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:36:48.300493 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38667
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:48.415675 27520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:48.415925 27520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:48.415968 27520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:48.419950 27520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:48.420010 27520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:48.420050 27520 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:36:48.420146 27520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:36:48.425396 27520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:38667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:48.426380 27520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:48.427414 27520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:48.436861 27526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:48.436864 27527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:48.436889 27529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:48.437120 27520 server_base.cc:1034] running on GCE node
I20260810 01:36:48.437691 27520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:48.438336 27520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:48.439522 27520 hybrid_clock.cc:648] HybridClock initialized: now 1786325808439492 us; error 51 us; skew 500 ppm
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:48.442412 27520 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:36:48.443346 27520 webserver.cc:460] Webserver started at http://127.24.205.130:44535/ using document root <none> and password file <none>
I20260810 01:36:48.443922 27520 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:48.444012 27520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:48.444284 27520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:48.446427 27520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "2642d4c4c339406e8bda0a66c30412f0"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "926c117a0997fb0e0246a1901d45fb38"
server_key_iv: "1072d87e592d19f257d80c84e9228561"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.447021 27520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "2642d4c4c339406e8bda0a66c30412f0"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "926c117a0997fb0e0246a1901d45fb38"
server_key_iv: "1072d87e592d19f257d80c84e9228561"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.450871 27520 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 01:36:48.453559 27540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:48.455075 27520 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:36:48.455204 27520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "2642d4c4c339406e8bda0a66c30412f0"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "926c117a0997fb0e0246a1901d45fb38"
server_key_iv: "1072d87e592d19f257d80c84e9228561"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.455322 27520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:48.476457 27520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:48.479950 27520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:48.480186 27520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:48.481684 27520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:48.481735 27520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:48.481801 27520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:48.481834 27520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:48.492519 27520 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:38991
I20260810 01:36:48.492581 27721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:38991 every 8 connection(s)
I20260810 01:36:48.493433 27520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:36:48.496572 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.482549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:50631 (local address 127.24.205.190:38667)
0810 01:36:48.482701 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.482706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.483586 (+ 880us) server_negotiation.cc:407] Connection header received
0810 01:36:48.484822 (+ 1236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.484829 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.484899 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.485007 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:48.486551 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.487454 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.489413 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.489636 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.489723 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.492909 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:48.492913 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:48.492915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:48.492944 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:48.494607 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.495167 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.495170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.495171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.495253 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.495559 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.495561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.495562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.495735 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:48.495810 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.496350 (+ 540us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.496452 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:36:48.497319 27555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.482952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38667 (local address 127.24.205.130:50631)
0810 01:36:48.483415 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.483465 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.484559 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.485232 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.485242 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.485653 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:48.486381 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.486401 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.487671 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.487675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.489295 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.489309 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.489817 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.489823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.490067 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.490749 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:48.490773 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:48.492730 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:48.494705 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.494710 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.494737 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.495038 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.495336 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.495338 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.495340 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.495472 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.495818 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:48.495822 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:48.496037 (+ 215us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.496262 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.496506 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":132,"threads_started":1}
I20260810 01:36:48.497872 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27520
I20260810 01:36:48.497956 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:36:48.498239 25398 external_mini_cluster.cc:1428] Setting key b8463b5023bdd124286c8bba376fd112
I20260810 01:36:48.498512 27725 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38667
I20260810 01:36:48.498682 27725 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:48.499220 27725 heartbeater.cc:511] Master 127.24.205.190:38667 requested a full tablet report, sending...
I20260810 01:36:48.500272 27172 ts_manager.cc:194] Registered new tserver with Master: 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130:38991)
I20260810 01:36:48.501048 27172 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:50631
I20260810 01:36:48.508262 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.500664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:58577 (local address 127.24.205.190:38667)
0810 01:36:48.500807 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.500814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.501122 (+ 308us) server_negotiation.cc:407] Connection header received
0810 01:36:48.501263 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.501269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.501324 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.501377 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:48.502082 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.502694 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.503587 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.503854 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.503967 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.505128 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:48.505132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:48.505135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:48.505159 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:48.506580 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.507007 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.507011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.507013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.507097 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.507375 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.507379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.507381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.507591 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:48.507697 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.507967 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.508106 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:36:48.508279 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.500592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38667 (local address 127.24.205.130:58577)
0810 01:36:48.501018 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.501035 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.501144 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.501529 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.501535 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.501782 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:48.501968 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.501979 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.502820 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.502823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.503457 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.503466 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.503971 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.503974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.504093 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.504571 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:48.504585 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:48.504997 (+ 412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:48.506696 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.506700 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.506703 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.506906 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.507189 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.507193 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.507195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.507283 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.507700 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:48.507704 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:48.507805 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.507910 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.508061 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":5,"thread_start_us":111,"threads_started":1}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:36:48.527067 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38667
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:48.643455 27741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:48.643729 27741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:48.643774 27741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:48.647765 27741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:48.647837 27741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:48.647876 27741 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:36:48.647908 27741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:36:48.653292 27741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:38667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:48.654354 27741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:48.655361 27741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:48.665299 27752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:48.665336 27760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:48.665417 27741 server_base.cc:1034] running on GCE node
W20260810 01:36:48.665336 27748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:48.666046 27741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:48.666683 27741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:48.667886 27741 hybrid_clock.cc:648] HybridClock initialized: now 1786325808667841 us; error 57 us; skew 500 ppm
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:48.671120 27741 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:36:48.672030 27741 webserver.cc:460] Webserver started at http://127.24.205.131:45167/ using document root <none> and password file <none>
I20260810 01:36:48.672681 27741 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:48.672777 27741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:48.673085 27741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:48.675271 27741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "473b5ccd5f1944198ddbd490f1c342d3"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "aaf8b7f5ea172383b7a026897354ac35"
server_key_iv: "414c16e49843df39860c8a95c84b8222"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.675848 27741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "473b5ccd5f1944198ddbd490f1c342d3"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "aaf8b7f5ea172383b7a026897354ac35"
server_key_iv: "414c16e49843df39860c8a95c84b8222"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.679693 27741 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 01:36:48.682344 27774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:48.683586 27741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:36:48.683732 27741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "473b5ccd5f1944198ddbd490f1c342d3"
format_stamp: "Formatted at 2026-08-10 01:36:48 on dist-test-slave-t3q3"
server_key: "aaf8b7f5ea172383b7a026897354ac35"
server_key_iv: "414c16e49843df39860c8a95c84b8222"
server_key_version: "encryptionkey@0"
I20260810 01:36:48.683849 27741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:48.693485 27741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:48.696744 27741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:48.696939 27741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:48.698437 27741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:48.698505 27741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:48.698570 27741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:48.698617 27741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:48.709621 27741 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:36295
I20260810 01:36:48.709692 27966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:36295 every 8 connection(s)
I20260810 01:36:48.710820 27741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:36:48.713465 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.699216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:34783 (local address 127.24.205.190:38667)
0810 01:36:48.699386 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.699391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.701151 (+ 1760us) server_negotiation.cc:407] Connection header received
0810 01:36:48.702474 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.702477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.702546 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.702640 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:48.704472 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.705381 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.706719 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.706988 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.707100 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.710067 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:48.710070 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:48.710072 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:48.710096 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:48.711618 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.712180 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.712182 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.712184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.712258 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.712545 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.712548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.712549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.712719 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:48.712793 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.713254 (+ 461us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.713348 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:36:48.714309 27791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.700412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38667 (local address 127.24.205.131:34783)
0810 01:36:48.700975 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.701041 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.702256 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.702851 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.702864 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.703420 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:48.704248 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.704276 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.705510 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.705514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.706599 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.706609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.707139 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.707143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.707344 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.708040 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:48.708080 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:48.709879 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:48.711747 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.711752 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.711765 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.712043 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.712321 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.712323 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.712324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.712452 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.712808 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:48.712812 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:48.713049 (+ 237us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.713195 (+ 146us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.713440 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":123,"threads_started":1}
I20260810 01:36:48.714485 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27741
I20260810 01:36:48.714632 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:36:48.714937 25398 external_mini_cluster.cc:1428] Setting key 80d29ddfc03d09a99d8a0ca3597e861f
I20260810 01:36:48.715591 27967 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38667
I20260810 01:36:48.715752 27967 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:48.716410 27967 heartbeater.cc:511] Master 127.24.205.190:38667 requested a full tablet report, sending...
I20260810 01:36:48.717450 27171 ts_manager.cc:194] Registered new tserver with Master: 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295)
I20260810 01:36:48.718040 27171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:34783
I20260810 01:36:48.725735 27974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.718027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38667 (local address 127.24.205.131:48723)
0810 01:36:48.718332 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.718346 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.718447 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.718680 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.718682 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.718911 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:48.719051 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.719059 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.720014 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.720016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.720638 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.720647 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.721042 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.721044 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.721114 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.721607 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:48.721619 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:48.721984 (+ 365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:48.723887 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.723890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.723892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.724290 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.724582 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:48.724585 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:48.724587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:48.724685 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:48.725205 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:48.725208 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:48.725308 (+ 100us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.725430 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.725577 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":141,"threads_started":1}
I20260810 01:36:48.725796 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.718102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:48723 (local address 127.24.205.190:38667)
0810 01:36:48.718341 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.718345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.718401 (+ 56us) server_negotiation.cc:407] Connection header received
0810 01:36:48.718530 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.718533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.718591 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.718671 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:48.719176 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.719896 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.720748 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.720951 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.721030 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.722123 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:48.722127 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:48.722129 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:48.722159 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:48.723735 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.724385 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.724388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.724390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.724481 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.724819 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.724822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.724823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.725044 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:48.725155 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.725522 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.725666 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260810 01:36:48.728991 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:36:48 dist-test-slave-t3q3 krb5kdc[27097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:48.759114 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.750887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50564 (local address 127.24.205.190:38667)
0810 01:36:48.751015 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.751019 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.751031 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:36:48.751074 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.751076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.751116 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.751183 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:48.751883 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.752475 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.753360 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.753569 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.753640 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.756113 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:48.756121 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:48.756126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:48.756161 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:48.757566 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.757979 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.757981 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.757983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.758056 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:48.758297 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:48.758299 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:48.758300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:48.758466 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:48.758565 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.758797 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.758894 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:36:48.762486 27171 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:36:48.765609 27171 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:48.780768 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.774598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:36295 (local address 127.0.0.1:39652)
0810 01:36:48.775287 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.775304 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.775399 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.776654 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.776658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.776680 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:48.776773 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.776781 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.778114 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.778118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.779389 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.779397 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.780203 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.780207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.780317 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.780356 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.780476 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.780635 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":120,"thread_start_us":101,"threads_started":1}
I20260810 01:36:48.780776 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.775275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39652 (local address 127.24.205.131:36295)
0810 01:36:48.776222 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.776233 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.776253 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:36:48.776328 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.776333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.776508 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.776669 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:48.776888 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.777979 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.779499 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.780044 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.780242 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.780385 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.780511 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.780613 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":97,"threads_started":1}
I20260810 01:36:48.780958 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.774830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:36225 (local address 127.0.0.1:55686)
0810 01:36:48.775791 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.775804 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.775899 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.776392 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.776395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.776427 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:48.776576 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.776588 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.777655 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.777660 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.779087 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.779102 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.780510 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.780513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.780621 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.780643 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.780718 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.780795 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"mutex_wait_us":4,"spinlock_wait_cycles":1792,"thread_start_us":95,"threads_started":1}
I20260810 01:36:48.781147 27997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.774426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:38991 (local address 127.0.0.1:57382)
0810 01:36:48.775111 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.775163 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.775295 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.776364 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.776370 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.776393 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:48.776635 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.776645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.778154 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.778157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.779443 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.779454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.780750 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.780753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.780845 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.780867 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.780932 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.781004 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"mutex_wait_us":134,"spinlock_wait_cycles":896,"thread_start_us":105,"threads_started":1}
I20260810 01:36:48.781548 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.774604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57382 (local address 127.24.205.130:38991)
0810 01:36:48.775634 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.775648 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.775674 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:36:48.775757 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.775763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.775995 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.776181 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:48.776768 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.777996 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.779592 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.780416 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.780565 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.780688 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.781311 (+ 623us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.781402 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":898,"thread_start_us":107,"threads_started":1}
I20260810 01:36:48.781558 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.775269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55686 (local address 127.24.205.129:36225)
0810 01:36:48.775740 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.775747 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.775878 (+ 131us) server_negotiation.cc:407] Connection header received
0810 01:36:48.776008 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.776016 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.776255 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.776416 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:48.776739 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.777543 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.779229 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.780190 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.780312 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.780438 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.781306 (+ 868us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.781416 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":98,"threads_started":1}
I20260810 01:36:48.783937 27860 tablet_service.cc:1467] Processing CreateTablet for tablet 13fad8765651422283d803872c7a8c32 (DEFAULT_TABLE table=test-table [id=a022402dc90546ed950abf42f9a2aee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:48.783936 27621 tablet_service.cc:1467] Processing CreateTablet for tablet 13fad8765651422283d803872c7a8c32 (DEFAULT_TABLE table=test-table [id=a022402dc90546ed950abf42f9a2aee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:48.785006 27860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13fad8765651422283d803872c7a8c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:48.785027 27621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13fad8765651422283d803872c7a8c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:48.786453 27400 tablet_service.cc:1467] Processing CreateTablet for tablet 13fad8765651422283d803872c7a8c32 (DEFAULT_TABLE table=test-table [id=a022402dc90546ed950abf42f9a2aee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:48.787523 27400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13fad8765651422283d803872c7a8c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:48.792289 28005 tablet_bootstrap.cc:492] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Bootstrap starting.
I20260810 01:36:48.794196 28006 tablet_bootstrap.cc:492] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Bootstrap starting.
I20260810 01:36:48.794741 28005 tablet_bootstrap.cc:654] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:48.795207 28007 tablet_bootstrap.cc:492] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Bootstrap starting.
I20260810 01:36:48.795986 28005 log.cc:824] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:48.796906 28006 tablet_bootstrap.cc:654] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:48.797456 28007 tablet_bootstrap.cc:654] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:48.797734 28006 log.cc:824] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:48.798254 28007 log.cc:824] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:48.798563 28005 tablet_bootstrap.cc:492] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: No bootstrap required, opened a new log
I20260810 01:36:48.798772 28005 ts_tablet_manager.cc:1397] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:36:48.799676 28006 tablet_bootstrap.cc:492] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: No bootstrap required, opened a new log
I20260810 01:36:48.799885 28006 ts_tablet_manager.cc:1397] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:36:48.800280 28007 tablet_bootstrap.cc:492] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: No bootstrap required, opened a new log
I20260810 01:36:48.800454 28007 ts_tablet_manager.cc:1397] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260810 01:36:48.802783 28005 raft_consensus.cc:348] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.803082 28005 raft_consensus.cc:374] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:48.803143 28005 raft_consensus.cc:729] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 473b5ccd5f1944198ddbd490f1c342d3, State: Initialized, Role: FOLLOWER
I20260810 01:36:48.803133 28006 raft_consensus.cc:348] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.803458 28006 raft_consensus.cc:374] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:48.803529 28006 raft_consensus.cc:729] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b12d94fd72422ba154bee5368dd294, State: Initialized, Role: FOLLOWER
I20260810 01:36:48.803601 28005 consensus_queue.cc:260] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.803979 28006 consensus_queue.cc:260] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.804268 28007 raft_consensus.cc:348] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.804504 28007 raft_consensus.cc:374] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:48.804563 28007 raft_consensus.cc:729] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2642d4c4c339406e8bda0a66c30412f0, State: Initialized, Role: FOLLOWER
I20260810 01:36:48.804704 28005 ts_tablet_manager.cc:1428] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:36:48.804922 27504 heartbeater.cc:503] Master 127.24.205.190:38667 was elected leader, sending a full tablet report...
I20260810 01:36:48.805014 27967 heartbeater.cc:503] Master 127.24.205.190:38667 was elected leader, sending a full tablet report...
I20260810 01:36:48.805047 28006 ts_tablet_manager.cc:1428] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:36:48.805006 28007 consensus_queue.cc:260] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.805601 27725 heartbeater.cc:503] Master 127.24.205.190:38667 was elected leader, sending a full tablet report...
I20260810 01:36:48.805924 28007 ts_tablet_manager.cc:1428] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260810 01:36:48.834286 28020 raft_consensus.cc:482] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:48.834510 28020 raft_consensus.cc:504] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.835817 28020 leader_election.cc:288] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295), 93b12d94fd72422ba154bee5368dd294 (127.24.205.129:36225)
I20260810 01:36:48.839880 27555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.836046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:36225 (local address 127.24.205.130:41313)
0810 01:36:48.836180 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.836197 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.836303 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.836613 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.836615 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.836632 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:48.836816 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.836823 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.837719 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.837722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.838598 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.838609 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.839507 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.839510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.839601 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.839621 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.839682 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.839738 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"spinlock_wait_cycles":20864}
I20260810 01:36:48.839967 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.836220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:41313 (local address 127.24.205.129:36225)
0810 01:36:48.836348 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.836353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.836370 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:36:48.836431 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.836434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.836504 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.836593 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:48.836958 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.837611 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.838751 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.839371 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.839502 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.839554 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.839722 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.839799 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:36:48.840617 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13fad8765651422283d803872c7a8c32" candidate_uuid: "2642d4c4c339406e8bda0a66c30412f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b12d94fd72422ba154bee5368dd294" is_pre_election: true
I20260810 01:36:48.840986 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.836224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:44641 (local address 127.24.205.131:36295)
0810 01:36:48.836348 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.836353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.836682 (+ 329us) server_negotiation.cc:407] Connection header received
0810 01:36:48.836811 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.836815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.836871 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.836978 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:48.837271 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.837828 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.839895 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.840465 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.840589 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.840648 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.840798 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.840873 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:36:48.841017 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.836082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:36295 (local address 127.24.205.130:44641)
0810 01:36:48.836575 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:48.836591 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:48.836703 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:48.837021 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:48.837024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:48.837044 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:48.837160 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.837167 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.837956 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.837959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.839756 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:48.839766 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.840586 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.840589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:48.840674 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.840694 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:36:48.840759 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 01:36:48.840854 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":118,"thread_start_us":126,"threads_started":1}
I20260810 01:36:48.840996 27426 raft_consensus.cc:2454] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2642d4c4c339406e8bda0a66c30412f0 in term 0.
I20260810 01:36:48.841542 27543 leader_election.cc:302] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2642d4c4c339406e8bda0a66c30412f0, 93b12d94fd72422ba154bee5368dd294; no voters:
I20260810 01:36:48.841571 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13fad8765651422283d803872c7a8c32" candidate_uuid: "2642d4c4c339406e8bda0a66c30412f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "473b5ccd5f1944198ddbd490f1c342d3" is_pre_election: true
I20260810 01:36:48.841845 27885 raft_consensus.cc:2454] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2642d4c4c339406e8bda0a66c30412f0 in term 0.
I20260810 01:36:48.841835 28020 raft_consensus.cc:2781] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:48.841933 28020 raft_consensus.cc:482] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:48.841992 28020 raft_consensus.cc:3037] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:48.843166 28020 raft_consensus.cc:504] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.843540 28020 leader_election.cc:288] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [CANDIDATE]: Term 1 election: Requested vote from peers 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295), 93b12d94fd72422ba154bee5368dd294 (127.24.205.129:36225)
I20260810 01:36:48.843887 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13fad8765651422283d803872c7a8c32" candidate_uuid: "2642d4c4c339406e8bda0a66c30412f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "473b5ccd5f1944198ddbd490f1c342d3"
I20260810 01:36:48.843930 27426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13fad8765651422283d803872c7a8c32" candidate_uuid: "2642d4c4c339406e8bda0a66c30412f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b12d94fd72422ba154bee5368dd294"
I20260810 01:36:48.844019 27885 raft_consensus.cc:3037] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:48.844092 27426 raft_consensus.cc:3037] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:48.845120 27885 raft_consensus.cc:2454] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2642d4c4c339406e8bda0a66c30412f0 in term 1.
I20260810 01:36:48.845167 27426 raft_consensus.cc:2454] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2642d4c4c339406e8bda0a66c30412f0 in term 1.
I20260810 01:36:48.845508 27543 leader_election.cc:302] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2642d4c4c339406e8bda0a66c30412f0, 93b12d94fd72422ba154bee5368dd294; no voters:
I20260810 01:36:48.845710 28020 raft_consensus.cc:2781] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:48.845945 28020 raft_consensus.cc:686] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 LEADER]: Becoming Leader. State: Replica: 2642d4c4c339406e8bda0a66c30412f0, State: Running, Role: LEADER
I20260810 01:36:48.846295 28020 consensus_queue.cc:237] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } }
I20260810 01:36:48.849638 27170 catalog_manager.cc:5495] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "2642d4c4c339406e8bda0a66c30412f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } health_report { overall_health: UNKNOWN } } }
I20260810 01:36:48.884877 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:48.881450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57396 (local address 127.24.205.130:38991)
0810 01:36:48.881577 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:48.881581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:48.881595 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:36:48.881779 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:48.881782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:48.881836 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:48.881922 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:48.882176 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.882671 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.883515 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:48.883740 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:48.883813 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:48.884103 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:48.884504 (+ 401us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:48.884594 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:48.884683 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 01:36:48.884740 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:36:48.890916 27426 raft_consensus.cc:1261] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Refusing update from remote peer 2642d4c4c339406e8bda0a66c30412f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:48.891702 28024 consensus_queue.cc:1035] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:48.892951 27885 raft_consensus.cc:1261] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Refusing update from remote peer 2642d4c4c339406e8bda0a66c30412f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:48.893528 28024 consensus_queue.cc:1035] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:48.898577 28034 mvcc.cc:205] Tried to move back new op lower bound from 7316790513209311232 to 7316790513036955648. Current Snapshot: MvccSnapshot[applied={T|T < 7316790513209311232}]
I20260810 01:36:48.900835 28036 mvcc.cc:205] Tried to move back new op lower bound from 7316790513209311232 to 7316790513036955648. Current Snapshot: MvccSnapshot[applied={T|T < 7316790513209311232}]
I20260810 01:36:48.911710 27172 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:48.911940 27172 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:48.914714 27172 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: Sending DeleteTablet for 3 replicas of tablet 13fad8765651422283d803872c7a8c32
I20260810 01:36:48.915701 27621 tablet_service.cc:1514] Processing DeleteTablet for tablet 13fad8765651422283d803872c7a8c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:48 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:57382
I20260810 01:36:48.915725 27400 tablet_service.cc:1514] Processing DeleteTablet for tablet 13fad8765651422283d803872c7a8c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:48 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:55686
I20260810 01:36:48.915714 27860 tablet_service.cc:1514] Processing DeleteTablet for tablet 13fad8765651422283d803872c7a8c32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:48 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:39652
I20260810 01:36:48.916393 28046 tablet_replica.cc:330] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: stopping tablet replica
I20260810 01:36:48.916714 28046 raft_consensus.cc:2229] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:36:48.917124 28046 raft_consensus.cc:2258] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:48.917164 27172 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:36:48.917518 28047 tablet_replica.cc:330] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: stopping tablet replica
W20260810 01:36:48.917625 27172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:48.917826 28047 raft_consensus.cc:2229] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:48.918138 28047 raft_consensus.cc:2258] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:48.919821 28047 ts_tablet_manager.cc:1905] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:48.920955 28046 ts_tablet_manager.cc:1905] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:48.922533 27860 tablet_service.cc:1467] Processing CreateTablet for tablet d05580f254c445f1906bb80ec3e24289 (DEFAULT_TABLE table=test-table [id=497fcd1c2dcf49e7872f7806f091d238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:48.922531 27400 tablet_service.cc:1467] Processing CreateTablet for tablet d05580f254c445f1906bb80ec3e24289 (DEFAULT_TABLE table=test-table [id=497fcd1c2dcf49e7872f7806f091d238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:48.922811 27860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d05580f254c445f1906bb80ec3e24289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:48.922811 27400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d05580f254c445f1906bb80ec3e24289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:48.924501 27621 tablet_service.cc:1467] Processing CreateTablet for tablet d05580f254c445f1906bb80ec3e24289 (DEFAULT_TABLE table=test-table [id=497fcd1c2dcf49e7872f7806f091d238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:48.924746 27621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d05580f254c445f1906bb80ec3e24289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:48.926292 28006 tablet_bootstrap.cc:492] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Bootstrap starting.
I20260810 01:36:48.926518 28047 ts_tablet_manager.cc:1918] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:36:48.926618 28047 log.cc:1196] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/13fad8765651422283d803872c7a8c32
I20260810 01:36:48.926944 28047 ts_tablet_manager.cc:1939] T 13fad8765651422283d803872c7a8c32 P 93b12d94fd72422ba154bee5368dd294: Deleting consensus metadata
I20260810 01:36:48.927369 28006 tablet_bootstrap.cc:654] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:48.928613 28046 ts_tablet_manager.cc:1918] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:36:48.928704 28046 log.cc:1196] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/13fad8765651422283d803872c7a8c32
I20260810 01:36:48.928848 28006 tablet_bootstrap.cc:492] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: No bootstrap required, opened a new log
I20260810 01:36:48.928927 28006 ts_tablet_manager.cc:1397] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:48.929018 28046 ts_tablet_manager.cc:1939] T 13fad8765651422283d803872c7a8c32 P 2642d4c4c339406e8bda0a66c30412f0: Deleting consensus metadata
I20260810 01:36:48.929312 27146 catalog_manager.cc:4841] TS 93b12d94fd72422ba154bee5368dd294 (127.24.205.129:36225): tablet 13fad8765651422283d803872c7a8c32 (table test-table [id=a022402dc90546ed950abf42f9a2aee3]) successfully deleted
I20260810 01:36:48.929600 28006 raft_consensus.cc:348] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:48.929747 28006 raft_consensus.cc:374] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:48.929787 28006 raft_consensus.cc:729] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b12d94fd72422ba154bee5368dd294, State: Initialized, Role: FOLLOWER
I20260810 01:36:48.929906 28006 consensus_queue.cc:260] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:48.930025 28007 tablet_bootstrap.cc:492] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Bootstrap starting.
I20260810 01:36:48.922573 28044 tablet_replica.cc:330] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: stopping tablet replica
I20260810 01:36:48.930160 28006 ts_tablet_manager.cc:1428] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:48.930380 28005 tablet_bootstrap.cc:492] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Bootstrap starting.
I20260810 01:36:48.930495 28044 raft_consensus.cc:2229] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:48.930822 28044 raft_consensus.cc:2258] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:48.931068 28007 tablet_bootstrap.cc:654] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:48.931474 28005 tablet_bootstrap.cc:654] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:48.931483 27154 catalog_manager.cc:4841] TS 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130:38991): tablet 13fad8765651422283d803872c7a8c32 (table test-table [id=a022402dc90546ed950abf42f9a2aee3]) successfully deleted
I20260810 01:36:48.932881 28007 tablet_bootstrap.cc:492] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: No bootstrap required, opened a new log
I20260810 01:36:48.932994 28007 ts_tablet_manager.cc:1397] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:36:48.933481 28007 raft_consensus.cc:348] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:48.933631 28007 raft_consensus.cc:374] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:48.933674 28007 raft_consensus.cc:729] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2642d4c4c339406e8bda0a66c30412f0, State: Initialized, Role: FOLLOWER
I20260810 01:36:48.933817 28007 consensus_queue.cc:260] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:48.934127 28007 ts_tablet_manager.cc:1428] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260810 01:36:48.935454 28044 ts_tablet_manager.cc:1905] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:48.938409 28044 ts_tablet_manager.cc:1918] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:36:48.938517 28044 log.cc:1196] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/13fad8765651422283d803872c7a8c32
I20260810 01:36:48.938874 28044 ts_tablet_manager.cc:1939] T 13fad8765651422283d803872c7a8c32 P 473b5ccd5f1944198ddbd490f1c342d3: Deleting consensus metadata
I20260810 01:36:48.940807 27142 catalog_manager.cc:4841] TS 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295): tablet 13fad8765651422283d803872c7a8c32 (table test-table [id=a022402dc90546ed950abf42f9a2aee3]) successfully deleted
I20260810 01:36:48.942020 28005 tablet_bootstrap.cc:492] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: No bootstrap required, opened a new log
I20260810 01:36:48.942224 28005 ts_tablet_manager.cc:1397] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260810 01:36:48.942651 28005 raft_consensus.cc:348] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:48.942770 28005 raft_consensus.cc:374] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:48.942811 28005 raft_consensus.cc:729] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 473b5ccd5f1944198ddbd490f1c342d3, State: Initialized, Role: FOLLOWER
I20260810 01:36:48.942945 28005 consensus_queue.cc:260] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:48.943243 28005 ts_tablet_manager.cc:1428] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260810 01:36:48.961807 27968 tablet.cc:2369] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:36:48.994696 27727 tablet.cc:2369] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:36:49.015810 27507 tablet.cc:2369] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:36:49.077512 28015 raft_consensus.cc:482] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:49.077685 28015 raft_consensus.cc:504] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.078760 28015 leader_election.cc:288] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130:38991), 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295)
I20260810 01:36:49.084344 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.079158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:59677 (local address 127.24.205.130:38991)
0810 01:36:49.079301 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.079307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.079516 (+ 209us) server_negotiation.cc:407] Connection header received
0810 01:36:49.079991 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.079994 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.080045 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.080132 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:49.080429 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.081148 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.082969 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.083602 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.083730 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.083783 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.084136 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.084212 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:36:49.084344 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.079169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:48125 (local address 127.24.205.131:36295)
0810 01:36:49.079319 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.079325 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.079595 (+ 270us) server_negotiation.cc:407] Connection header received
0810 01:36:49.079713 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.079716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.079779 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.079883 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:49.080270 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.081049 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.082969 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.083594 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.083730 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.083783 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.084136 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.084212 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 01:36:49.084452 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.079032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:38991 (local address 127.24.205.129:59677)
0810 01:36:49.079403 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:49.079419 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:49.079559 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:49.080160 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:49.080166 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:49.080206 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:49.080324 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.080329 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.081256 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.081259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.082814 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.082821 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.083753 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.083757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.083955 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.084018 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 01:36:49.084118 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 01:36:49.084258 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":241,"thread_start_us":90,"threads_started":1}
I20260810 01:36:49.084543 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.079032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:36295 (local address 127.24.205.129:48125)
0810 01:36:49.079501 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:49.079515 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:49.079603 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:49.079928 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:49.079930 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:49.079950 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:49.080113 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.080125 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.081167 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.081170 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.082808 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.082821 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.083753 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.083757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.083929 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.084008 (+ 79us) client_negotiation.cc:769] Sending connection context
0810 01:36:49.084118 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 01:36:49.084258 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":315,"thread_start_us":121,"threads_started":1}
I20260810 01:36:49.085050 27648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d05580f254c445f1906bb80ec3e24289" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2642d4c4c339406e8bda0a66c30412f0" is_pre_election: true
I20260810 01:36:49.085103 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d05580f254c445f1906bb80ec3e24289" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "473b5ccd5f1944198ddbd490f1c342d3" is_pre_election: true
I20260810 01:36:49.085264 27885 raft_consensus.cc:2454] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 0.
I20260810 01:36:49.085300 27648 raft_consensus.cc:2454] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 0.
I20260810 01:36:49.085695 27317 leader_election.cc:302] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2642d4c4c339406e8bda0a66c30412f0, 473b5ccd5f1944198ddbd490f1c342d3, 93b12d94fd72422ba154bee5368dd294; no voters:
I20260810 01:36:49.085925 28015 raft_consensus.cc:2781] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:49.085999 28015 raft_consensus.cc:482] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:49.086061 28015 raft_consensus.cc:3037] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:49.087263 28015 raft_consensus.cc:504] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.087590 28015 leader_election.cc:288] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 election: Requested vote from peers 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130:38991), 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295)
I20260810 01:36:49.087925 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d05580f254c445f1906bb80ec3e24289" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "473b5ccd5f1944198ddbd490f1c342d3"
I20260810 01:36:49.088090 27885 raft_consensus.cc:3037] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:49.088178 27648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d05580f254c445f1906bb80ec3e24289" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2642d4c4c339406e8bda0a66c30412f0"
I20260810 01:36:49.088335 27648 raft_consensus.cc:3037] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:49.089053 27885 raft_consensus.cc:2454] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 1.
I20260810 01:36:49.089336 27648 raft_consensus.cc:2454] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 1.
I20260810 01:36:49.089377 27317 leader_election.cc:302] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 473b5ccd5f1944198ddbd490f1c342d3, 93b12d94fd72422ba154bee5368dd294; no voters:
I20260810 01:36:49.089612 28015 raft_consensus.cc:2781] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:49.089843 28015 raft_consensus.cc:686] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 1 LEADER]: Becoming Leader. State: Replica: 93b12d94fd72422ba154bee5368dd294, State: Running, Role: LEADER
I20260810 01:36:49.090097 28015 consensus_queue.cc:237] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.092489 27170 catalog_manager.cc:5495] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b12d94fd72422ba154bee5368dd294 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } health_report { overall_health: UNKNOWN } } }
Aug 10 01:36:49 dist-test-slave-t3q3 krb5kdc[27097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325807, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:49.154758 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.145907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.24.205.190:38667)
0810 01:36:49.146057 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.146062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.146276 (+ 214us) server_negotiation.cc:407] Connection header received
0810 01:36:49.146384 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.146386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.146428 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.146500 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:49.147150 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.147667 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.148586 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.148804 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.148900 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.151334 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:49.151337 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:49.151339 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:49.151361 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:49.152898 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:49.153500 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:49.153504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:49.153508 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:49.153588 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:49.153853 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:49.153856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:49.153858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:49.154036 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:49.154141 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.154434 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.154622 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":50}
I20260810 01:36:49.154759 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.145874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38667 (local address 127.0.0.1:50566)
0810 01:36:49.146189 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:49.146203 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:49.146306 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:49.146548 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:49.146550 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:49.146951 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:49.147050 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.147056 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.147762 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.147764 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.148472 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.148481 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.148955 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.148958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.149034 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.149644 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:49.149656 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:49.151206 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:49.153148 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:49.153160 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:49.153167 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:49.153400 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:49.153675 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:49.153680 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:49.153682 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:49.153760 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:49.154141 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:49.154149 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:49.154259 (+ 110us) client_negotiation.cc:769] Sending connection context
0810 01:36:49.154375 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 01:36:49.154560 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":133,"threads_started":1}
I20260810 01:36:49.158907 27170 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:50566:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 01:36:49.159797 27170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:49.164731 27400 tablet_service.cc:1467] Processing CreateTablet for tablet 1b368a91fd7e415d92dd2e3baf2520eb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1279c0f8730449a1abf028b11dd6d225]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:36:49.164947 27860 tablet_service.cc:1467] Processing CreateTablet for tablet 1b368a91fd7e415d92dd2e3baf2520eb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1279c0f8730449a1abf028b11dd6d225]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:36:49.165187 27400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b368a91fd7e415d92dd2e3baf2520eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:49.165300 27860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b368a91fd7e415d92dd2e3baf2520eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:49.164726 27621 tablet_service.cc:1467] Processing CreateTablet for tablet 1b368a91fd7e415d92dd2e3baf2520eb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1279c0f8730449a1abf028b11dd6d225]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:36:49.167030 27621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b368a91fd7e415d92dd2e3baf2520eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:49.167697 28005 tablet_bootstrap.cc:492] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: Bootstrap starting.
I20260810 01:36:49.168730 28005 tablet_bootstrap.cc:654] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:49.168978 28006 tablet_bootstrap.cc:492] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: Bootstrap starting.
I20260810 01:36:49.169795 28007 tablet_bootstrap.cc:492] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: Bootstrap starting.
I20260810 01:36:49.170079 28006 tablet_bootstrap.cc:654] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:49.170578 28007 tablet_bootstrap.cc:654] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:49.171329 28006 tablet_bootstrap.cc:492] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: No bootstrap required, opened a new log
I20260810 01:36:49.171428 28006 ts_tablet_manager.cc:1397] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:49.171587 28005 tablet_bootstrap.cc:492] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: No bootstrap required, opened a new log
I20260810 01:36:49.171695 28005 ts_tablet_manager.cc:1397] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 01:36:49.171922 28006 raft_consensus.cc:348] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.172051 28006 raft_consensus.cc:374] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:49.172116 28006 raft_consensus.cc:729] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b12d94fd72422ba154bee5368dd294, State: Initialized, Role: FOLLOWER
I20260810 01:36:49.172169 28005 raft_consensus.cc:348] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.172302 28005 raft_consensus.cc:374] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:49.172253 28006 consensus_queue.cc:260] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.172335 28005 raft_consensus.cc:729] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 473b5ccd5f1944198ddbd490f1c342d3, State: Initialized, Role: FOLLOWER
I20260810 01:36:49.172461 28005 consensus_queue.cc:260] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.172554 28006 ts_tablet_manager.cc:1428] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 01:36:49.172552 28015 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.172717 28015 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:49.172724 28005 ts_tablet_manager.cc:1428] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:49.174120 28013 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.174300 28013 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:49.174798 28007 tablet_bootstrap.cc:492] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: No bootstrap required, opened a new log
I20260810 01:36:49.174896 28007 ts_tablet_manager.cc:1397] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260810 01:36:49.175340 28007 raft_consensus.cc:348] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.175462 28007 raft_consensus.cc:374] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:49.175495 28007 raft_consensus.cc:729] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2642d4c4c339406e8bda0a66c30412f0, State: Initialized, Role: FOLLOWER
I20260810 01:36:49.175638 28007 consensus_queue.cc:260] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.175911 28007 ts_tablet_manager.cc:1428] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:49.176119 28024 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.176240 28024 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:49.293689 28015 raft_consensus.cc:482] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:49.293860 28015 raft_consensus.cc:504] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.294319 28015 leader_election.cc:288] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130:38991), 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295)
I20260810 01:36:49.294739 27648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b368a91fd7e415d92dd2e3baf2520eb" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2642d4c4c339406e8bda0a66c30412f0" is_pre_election: true
I20260810 01:36:49.294804 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b368a91fd7e415d92dd2e3baf2520eb" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "473b5ccd5f1944198ddbd490f1c342d3" is_pre_election: true
I20260810 01:36:49.294903 27648 raft_consensus.cc:2454] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 0.
I20260810 01:36:49.295015 27885 raft_consensus.cc:2454] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 0.
I20260810 01:36:49.295243 27323 leader_election.cc:302] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2642d4c4c339406e8bda0a66c30412f0, 93b12d94fd72422ba154bee5368dd294; no voters:
I20260810 01:36:49.295434 28015 raft_consensus.cc:2781] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:49.295499 28015 raft_consensus.cc:482] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:49.295562 28015 raft_consensus.cc:3037] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:49.296682 28015 raft_consensus.cc:504] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.297047 28015 leader_election.cc:288] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 election: Requested vote from peers 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130:38991), 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295)
I20260810 01:36:49.297401 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b368a91fd7e415d92dd2e3baf2520eb" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "473b5ccd5f1944198ddbd490f1c342d3"
I20260810 01:36:49.297401 27648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b368a91fd7e415d92dd2e3baf2520eb" candidate_uuid: "93b12d94fd72422ba154bee5368dd294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2642d4c4c339406e8bda0a66c30412f0"
I20260810 01:36:49.297528 27885 raft_consensus.cc:3037] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:49.297528 27648 raft_consensus.cc:3037] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:49.298660 27885 raft_consensus.cc:2454] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 1.
I20260810 01:36:49.298660 27648 raft_consensus.cc:2454] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b12d94fd72422ba154bee5368dd294 in term 1.
I20260810 01:36:49.298950 27323 leader_election.cc:302] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2642d4c4c339406e8bda0a66c30412f0, 93b12d94fd72422ba154bee5368dd294; no voters:
I20260810 01:36:49.299113 28015 raft_consensus.cc:2781] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:49.299207 28015 raft_consensus.cc:686] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [term 1 LEADER]: Becoming Leader. State: Replica: 93b12d94fd72422ba154bee5368dd294, State: Running, Role: LEADER
I20260810 01:36:49.299345 28015 consensus_queue.cc:237] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } }
I20260810 01:36:49.300036 28054 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: TxnStatusTablet state changed. Reason: New leader 93b12d94fd72422ba154bee5368dd294. Latest consensus state: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.300166 28054 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:36:49.300560 28073 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 01:36:49.300781 28073 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 01:36:49.301330 27172 catalog_manager.cc:5495] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b12d94fd72422ba154bee5368dd294 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } health_report { overall_health: UNKNOWN } } }
I20260810 01:36:49.333613 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.329815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55696 (local address 127.24.205.129:36225)
0810 01:36:49.329954 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.329960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.329974 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:36:49.330206 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.330209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.330267 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.330362 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:49.330633 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.331144 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.332008 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.332300 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.332412 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.332719 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:49.333199 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:49.333331 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.333411 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.333467 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:36:49.333612 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.329710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:36225 (local address 127.0.0.1:55696)
0810 01:36:49.329901 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:49.329917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:49.330037 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:49.330391 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:49.330393 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:49.330401 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:36:49.330513 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.330519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.331255 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.331260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.331884 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.331893 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.332412 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.332416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.332515 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.332560 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:36:49.333304 (+ 744us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:36:49.333323 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:36:49.333391 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 01:36:49.333480 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 01:36:49.336936 27885 raft_consensus.cc:1261] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Refusing update from remote peer 93b12d94fd72422ba154bee5368dd294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:49.337157 27648 raft_consensus.cc:1261] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Refusing update from remote peer 93b12d94fd72422ba154bee5368dd294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:49.337473 28054 consensus_queue.cc:1035] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:49.337747 28015 consensus_queue.cc:1035] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:49.339275 28013 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: TxnStatusTablet state changed. Reason: New leader 93b12d94fd72422ba154bee5368dd294. Latest consensus state: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.339396 28013 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:49.339465 28024 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: TxnStatusTablet state changed. Reason: New leader 93b12d94fd72422ba154bee5368dd294. Latest consensus state: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.339583 28024 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:49.343044 28081 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.343261 28081 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:36:49.343518 28081 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.343683 28081 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 93b12d94fd72422ba154bee5368dd294: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:36:49.343892 28013 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.344005 28013 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 473b5ccd5f1944198ddbd490f1c342d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:49.342891 28029 mvcc.cc:205] Tried to move back new op lower bound from 7316790515038609408 to 7316790514891550720. Current Snapshot: MvccSnapshot[applied={T|T < 7316790515038609408}]
I20260810 01:36:49.346657 28024 tablet_replica.cc:439] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93b12d94fd72422ba154bee5368dd294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93b12d94fd72422ba154bee5368dd294" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36225 } } peers { permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 } } peers { permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 } } }
I20260810 01:36:49.346781 28024 tablet_replica.cc:442] T 1b368a91fd7e415d92dd2e3baf2520eb P 2642d4c4c339406e8bda0a66c30412f0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:49.353549 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.350070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55700 (local address 127.24.205.129:36225)
0810 01:36:49.350188 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.350193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.350225 (+ 32us) server_negotiation.cc:407] Connection header received
0810 01:36:49.350360 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.350363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.350413 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.350507 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:49.350737 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.351519 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.352439 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.352779 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.352888 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.353132 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:49.353214 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:49.353287 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.353362 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.353415 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 01:36:49.365091 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.361295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:34037 (local address 127.24.205.129:36225)
0810 01:36:49.361424 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.361428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.361651 (+ 223us) server_negotiation.cc:407] Connection header received
0810 01:36:49.361756 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.361758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.361798 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.361858 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:49.362133 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.362609 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.363897 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.364215 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.364307 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.364661 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:49.364728 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:49.364784 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.364903 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.364946 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:36:49.365216 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.361243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:36225 (local address 127.24.205.129:34037)
0810 01:36:49.361552 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:49.361568 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:49.361679 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:49.361890 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:49.361893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:49.361913 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:36:49.362049 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.362056 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.362715 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.362719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.363737 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:49.363749 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.364356 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.364360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:49.364458 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.364516 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:36:49.364811 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:36:49.364818 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:36:49.364885 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 01:36:49.364968 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":119,"threads_started":1}
I20260810 01:36:49.373175 27885 raft_consensus.cc:1261] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Refusing update from remote peer 93b12d94fd72422ba154bee5368dd294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:49.373277 27648 raft_consensus.cc:1261] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Refusing update from remote peer 93b12d94fd72422ba154bee5368dd294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:49.373626 28081 consensus_queue.cc:1035] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "473b5ccd5f1944198ddbd490f1c342d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 36295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:49.373790 28054 consensus_queue.cc:1035] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2642d4c4c339406e8bda0a66c30412f0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 38991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:49.419291 27168 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:49.419485 27168 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:49.421727 27168 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c80b2991f510486a8e5bd98d67ce8403: Sending DeleteTablet for 3 replicas of tablet d05580f254c445f1906bb80ec3e24289
I20260810 01:36:49.422319 27398 tablet_service.cc:1514] Processing DeleteTablet for tablet d05580f254c445f1906bb80ec3e24289 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:49 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:55686
I20260810 01:36:49.422506 28047 tablet_replica.cc:330] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: stopping tablet replica
I20260810 01:36:49.422621 28047 raft_consensus.cc:2229] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:36:49.422622 27621 tablet_service.cc:1514] Processing DeleteTablet for tablet d05580f254c445f1906bb80ec3e24289 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:49 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:57382
I20260810 01:36:49.422832 27860 tablet_service.cc:1514] Processing DeleteTablet for tablet d05580f254c445f1906bb80ec3e24289 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:49 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:39652
I20260810 01:36:49.422935 28047 raft_consensus.cc:2258] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:49.423031 28046 tablet_replica.cc:330] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: stopping tablet replica
I20260810 01:36:49.423171 28046 raft_consensus.cc:2229] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:49.423286 28046 raft_consensus.cc:2258] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:49.423442 28044 tablet_replica.cc:330] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: stopping tablet replica
I20260810 01:36:49.423563 28044 raft_consensus.cc:2229] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:49.423768 28044 raft_consensus.cc:2258] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:49.424722 28044 ts_tablet_manager.cc:1905] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:49.424722 28046 ts_tablet_manager.cc:1905] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:49.427222 28047 ts_tablet_manager.cc:1905] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:49.427605 28044 ts_tablet_manager.cc:1918] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:49.427685 28044 log.cc:1196] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/d05580f254c445f1906bb80ec3e24289
I20260810 01:36:49.427693 28046 ts_tablet_manager.cc:1918] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:49.427758 28046 log.cc:1196] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/d05580f254c445f1906bb80ec3e24289
I20260810 01:36:49.427968 28044 ts_tablet_manager.cc:1939] T d05580f254c445f1906bb80ec3e24289 P 473b5ccd5f1944198ddbd490f1c342d3: Deleting consensus metadata
I20260810 01:36:49.428046 28046 ts_tablet_manager.cc:1939] T d05580f254c445f1906bb80ec3e24289 P 2642d4c4c339406e8bda0a66c30412f0: Deleting consensus metadata
I20260810 01:36:49.428732 27142 catalog_manager.cc:4841] TS 473b5ccd5f1944198ddbd490f1c342d3 (127.24.205.131:36295): tablet d05580f254c445f1906bb80ec3e24289 (table test-table [id=497fcd1c2dcf49e7872f7806f091d238]) successfully deleted
I20260810 01:36:49.429711 27154 catalog_manager.cc:4841] TS 2642d4c4c339406e8bda0a66c30412f0 (127.24.205.130:38991): tablet d05580f254c445f1906bb80ec3e24289 (table test-table [id=497fcd1c2dcf49e7872f7806f091d238]) successfully deleted
I20260810 01:36:49.430241 28047 ts_tablet_manager.cc:1918] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:49.430331 28047 log.cc:1196] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/d05580f254c445f1906bb80ec3e24289
I20260810 01:36:49.430596 28047 ts_tablet_manager.cc:1939] T d05580f254c445f1906bb80ec3e24289 P 93b12d94fd72422ba154bee5368dd294: Deleting consensus metadata
I20260810 01:36:49.431283 27146 catalog_manager.cc:4841] TS 93b12d94fd72422ba154bee5368dd294 (127.24.205.129:36225): tablet d05580f254c445f1906bb80ec3e24289 (table test-table [id=497fcd1c2dcf49e7872f7806f091d238]) successfully deleted
Aug 10 01:36:49 dist-test-slave-t3q3 krb5kdc[27097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325808, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:36:49.439319 28003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.428381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57162 (local address 127.24.205.129:36225)
0810 01:36:49.428547 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.428552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.428569 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:36:49.428615 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.428621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.428675 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.428755 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:49.430245 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.430924 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.431910 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.432210 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.432319 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.435575 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:49.435585 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:49.435600 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:49.435628 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:49.437410 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:49.437882 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:49.437887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:49.437888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:49.437985 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:49.438290 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:49.438293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:49.438295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:49.438553 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:49.438790 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.438991 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.439113 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260810 01:36:49.439888 27464 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57162
I20260810 01:36:49.449158 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:49.441695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53682 (local address 127.24.205.190:38667)
0810 01:36:49.441827 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:49.441831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:49.441973 (+ 142us) server_negotiation.cc:407] Connection header received
0810 01:36:49.442100 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:49.442103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:49.442149 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:49.442238 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:49.442866 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.443505 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.444379 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:49.444611 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:49.444713 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:49.446038 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:49.446042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:49.446044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:49.446073 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:49.447481 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:49.447891 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:49.447895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:49.447897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:49.447983 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:49.448303 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:49.448306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:49.448308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:49.448486 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:49.448620 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:49.448866 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 01:36:49.448981 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 01:36:49.449626 27168 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53682
I20260810 01:36:49.451345 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27293
I20260810 01:36:49.464802 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27520
I20260810 01:36:49.479215 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27741
I20260810 01:36:49.494486 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27119
2026-08-10T01:36:49Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3173 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:36:49 dist-test-slave-t3q3 krb5kdc[28103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:36:49 dist-test-slave-t3q3 krb5kdc[28103](info): set up 2 sockets
Aug 10 01:36:49 dist-test-slave-t3q3 krb5kdc[28103](info): commencing operation
krb5kdc: starting...
W20260810 01:36:50.766386 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:36:50 dist-test-slave-t3q3 krb5kdc[28103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:36:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:36:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:36:50.890988 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43749
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:43749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:51.010766 28122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:51.011092 28122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:51.011162 28122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:51.015468 28122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:36:51.015581 28122 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 01:36:51.015616 28122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:51.015662 28122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:51.015717 28122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:36:51.015753 28122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:36:51.021301 28122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:43749
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:51.022470 28122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:51.023545 28122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:51.032444 28137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:51.032455 28134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:51.032579 28122 server_base.cc:1034] running on GCE node
W20260810 01:36:51.032464 28135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:51.033325 28122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:51.034351 28122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:51.035538 28122 hybrid_clock.cc:648] HybridClock initialized: now 1786325811035523 us; error 25 us; skew 500 ppm
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:51.038585 28122 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:36:51.039502 28122 webserver.cc:460] Webserver started at http://127.24.205.190:43149/ using document root <none> and password file <none>
I20260810 01:36:51.040153 28122 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:51.040249 28122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:51.040503 28122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:51.042605 28122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "3ef3fe389d514801908218199483d3e5"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "3e0e7b11be83e8be31ee77a600d75cab"
server_key_iv: "ccc2dcd5348d0bc274800c7bac0af368"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.043202 28122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "3ef3fe389d514801908218199483d3e5"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "3e0e7b11be83e8be31ee77a600d75cab"
server_key_iv: "ccc2dcd5348d0bc274800c7bac0af368"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.047223 28122 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:36:51.049889 28148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:51.051256 28122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:51.051416 28122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "3ef3fe389d514801908218199483d3e5"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "3e0e7b11be83e8be31ee77a600d75cab"
server_key_iv: "ccc2dcd5348d0bc274800c7bac0af368"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.051549 28122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:51.066339 28122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:51.069782 28122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:51.069994 28122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:51.078393 28122 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:43749
I20260810 01:36:51.078405 28250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:43749 every 8 connection(s)
I20260810 01:36:51.079368 28122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:36:51.082234 28251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:51.087713 28251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Bootstrap starting.
I20260810 01:36:51.088256 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28122
I20260810 01:36:51.088378 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:36:51.088654 25398 external_mini_cluster.cc:1428] Setting key 1424513b94a9c2941bc45d8c2afd7681
I20260810 01:36:51.090529 28251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:51.091279 28251 log.cc:824] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:51.093547 28251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: No bootstrap required, opened a new log
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:51.098111 28251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ef3fe389d514801908218199483d3e5" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43749 } }
I20260810 01:36:51.098383 28251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:51.098460 28251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef3fe389d514801908218199483d3e5, State: Initialized, Role: FOLLOWER
I20260810 01:36:51.098940 28251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ef3fe389d514801908218199483d3e5" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43749 } }
I20260810 01:36:51.099131 28251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:36:51.099208 28251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:36:51.099331 28251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:51.100266 28251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ef3fe389d514801908218199483d3e5" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43749 } }
I20260810 01:36:51.100606 28251 leader_election.cc:302] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ef3fe389d514801908218199483d3e5; no voters:
I20260810 01:36:51.100935 28251 leader_election.cc:288] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:36:51.101025 28257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:51.101210 28257 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3ef3fe389d514801908218199483d3e5, State: Running, Role: LEADER
I20260810 01:36:51.101504 28257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ef3fe389d514801908218199483d3e5" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43749 } }
I20260810 01:36:51.102245 28251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:36:51.104034 28259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ef3fe389d514801908218199483d3e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ef3fe389d514801908218199483d3e5" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43749 } } }
I20260810 01:36:51.104200 28259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:36:51.105041 28271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:36:51.105163 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.089990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57560 (local address 127.24.205.190:43749)
0810 01:36:51.090442 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.090471 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.090508 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:36:51.091219 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.091238 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.091651 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.092104 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.092987 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.094028 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.095261 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.095729 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.095858 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.098938 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.098944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.098962 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.098994 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.100954 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.101533 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.101539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.101545 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.101698 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.102026 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.102030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.102031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.102544 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.103411 (+ 867us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.103815 (+ 404us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.104186 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":148,"threads_started":1}
I20260810 01:36:51.104039 28258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ef3fe389d514801908218199483d3e5. Latest consensus state: current_term: 1 leader_uuid: "3ef3fe389d514801908218199483d3e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ef3fe389d514801908218199483d3e5" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43749 } } }
I20260810 01:36:51.106428 28258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:36:51.107873 28271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:36:51.113160 28271 catalog_manager.cc:1347] Generated new cluster ID: f231a7542d604c75973d52eac0e43350
I20260810 01:36:51.113237 28271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:36:51.125427 28271 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:36:51.126334 28271 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:36:51.132771 28271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Generated new TSK 0
I20260810 01:36:51.133430 28271 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:36:51.170409 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43749
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:51.286108 28289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:51.286372 28289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:51.286417 28289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:51.290416 28289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:51.290473 28289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:51.290511 28289 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 01:36:51.290525 28289 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:36:51.290597 28289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:36:51.295694 28289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:43749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:51.296847 28289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:51.297883 28289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:51.307691 28298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:51.307682 28297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:51.307684 28301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:51.307806 28289 server_base.cc:1034] running on GCE node
I20260810 01:36:51.308386 28289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:51.308971 28289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:51.310168 28289 hybrid_clock.cc:648] HybridClock initialized: now 1786325811310140 us; error 44 us; skew 500 ppm
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:51.316958 28289 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:36:51.317909 28289 webserver.cc:460] Webserver started at http://127.24.205.129:34355/ using document root <none> and password file <none>
I20260810 01:36:51.318493 28289 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:51.318601 28289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:51.318840 28289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:51.321012 28289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "d8aaf709be804d6fa0cba0b167a0c134"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "7daa5c8b0dc78c8d50067342c5abc4f0"
server_key_iv: "a2b48ecdce0c847007585cc9ca149fd9"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.321623 28289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "d8aaf709be804d6fa0cba0b167a0c134"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "7daa5c8b0dc78c8d50067342c5abc4f0"
server_key_iv: "a2b48ecdce0c847007585cc9ca149fd9"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.325446 28289 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:36:51.327883 28310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:51.329227 28289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:36:51.329361 28289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "d8aaf709be804d6fa0cba0b167a0c134"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "7daa5c8b0dc78c8d50067342c5abc4f0"
server_key_iv: "a2b48ecdce0c847007585cc9ca149fd9"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.329478 28289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:51.355753 28289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:51.359344 28289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:51.359584 28289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:51.361244 28289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:51.361331 28289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:51.361404 28289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:51.361450 28289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:51.372643 28289 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:44015
I20260810 01:36:51.372725 28501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:44015 every 8 connection(s)
I20260810 01:36:51.373853 28289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:36:51.376575 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.362335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:46495 (local address 127.24.205.190:43749)
0810 01:36:51.362492 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.362496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.363689 (+ 1193us) server_negotiation.cc:407] Connection header received
0810 01:36:51.365005 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.365008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.365072 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.365181 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.367048 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.367940 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.369166 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.369424 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.369540 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.372734 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.372738 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.372741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.372769 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.374530 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.375086 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.375089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.375090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.375180 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.375494 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.375497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.375498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.375683 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.375762 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.376325 (+ 563us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.376449 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:36:51.377413 28329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.362894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43749 (local address 127.24.205.129:46495)
0810 01:36:51.363493 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.363540 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.364692 (+ 1152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.365451 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.365462 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.366027 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:51.366843 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.366868 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.368103 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.368116 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.369019 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.369029 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.369584 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.369588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.369772 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.370558 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:51.370584 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:51.372537 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:51.374678 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.374686 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.374701 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.374962 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.375276 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.375278 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.375280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.375408 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.375769 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:51.375774 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:51.376002 (+ 228us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.376242 (+ 240us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.376506 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":155,"threads_started":1}
I20260810 01:36:51.377928 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28289
I20260810 01:36:51.378022 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:36:51.378353 25398 external_mini_cluster.cc:1428] Setting key 578076a127eda6a77a2c5968ef81eeda
I20260810 01:36:51.378724 28503 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43749
I20260810 01:36:51.378954 28503 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:51.379503 28503 heartbeater.cc:511] Master 127.24.205.190:43749 requested a full tablet report, sending...
I20260810 01:36:51.381934 28180 ts_manager.cc:194] Registered new tserver with Master: d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015)
I20260810 01:36:51.383536 28180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:46495
I20260810 01:36:51.388551 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.381104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:47823 (local address 127.24.205.190:43749)
0810 01:36:51.381293 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.381298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.381535 (+ 237us) server_negotiation.cc:407] Connection header received
0810 01:36:51.381703 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.381709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.381765 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.381849 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.382351 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.382846 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.383778 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.383981 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.384123 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.385349 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.385353 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.385355 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.385379 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.386858 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.387317 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.387321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.387323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.387400 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.387676 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.387681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.387683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.387849 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.387954 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.388269 (+ 315us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.388378 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260810 01:36:51.388547 28512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.381014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43749 (local address 127.24.205.129:47823)
0810 01:36:51.381437 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.381451 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.381591 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.381880 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.381883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.382103 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:51.382240 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.382248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.382983 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.382987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.383589 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.383597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.384115 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.384118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.384213 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.384762 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:51.384776 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:51.385192 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:51.386966 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.386972 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.386974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.387209 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.387496 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.387499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.387501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.387586 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.387943 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:51.387946 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:51.388052 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.388205 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.388349 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:36:51.408572 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43749
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:51.524437 28519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:51.524818 28519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:51.524875 28519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:51.529045 28519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:51.529119 28519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:51.529162 28519 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 01:36:51.529178 28519 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:36:51.529217 28519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:36:51.534741 28519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:43749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:51.535929 28519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:51.537083 28519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:51.547006 28533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:51.547178 28527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:51.547006 28529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:51.547420 28519 server_base.cc:1034] running on GCE node
I20260810 01:36:51.547907 28519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:51.548622 28519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:51.549839 28519 hybrid_clock.cc:648] HybridClock initialized: now 1786325811549817 us; error 32 us; skew 500 ppm
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:51.553133 28519 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:36:51.554035 28519 webserver.cc:460] Webserver started at http://127.24.205.130:35209/ using document root <none> and password file <none>
I20260810 01:36:51.554641 28519 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:51.554733 28519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:51.554975 28519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:51.557260 28519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "93b7785b10fe4533b7e505d3bf801d10"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "8830270e4949dcf089a1a729ca7be972"
server_key_iv: "725b755676f6d5889d730d5218f6952f"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.557850 28519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "93b7785b10fe4533b7e505d3bf801d10"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "8830270e4949dcf089a1a729ca7be972"
server_key_iv: "725b755676f6d5889d730d5218f6952f"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.561803 28519 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:36:51.564684 28544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:51.566007 28519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:36:51.566149 28519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "93b7785b10fe4533b7e505d3bf801d10"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "8830270e4949dcf089a1a729ca7be972"
server_key_iv: "725b755676f6d5889d730d5218f6952f"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.566272 28519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:51.579643 28519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:51.582564 28519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:51.582772 28519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:51.584316 28519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:51.584403 28519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:51.584478 28519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:51.584524 28519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:51.595682 28519 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:46533
I20260810 01:36:51.595842 28729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:46533 every 8 connection(s)
I20260810 01:36:51.596868 28519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:36:51.599323 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.585195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:33913 (local address 127.24.205.190:43749)
0810 01:36:51.585331 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.585335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.586417 (+ 1082us) server_negotiation.cc:407] Connection header received
0810 01:36:51.587424 (+ 1007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.587428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.587495 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.587559 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.589480 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.590057 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.592005 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.592418 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.592541 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.595580 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.595584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.595587 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.595639 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.597173 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.597782 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.597789 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.597792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.597884 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.598228 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.598234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.598239 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.598433 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.598541 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.599031 (+ 490us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.599159 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:36:51.600198 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.585773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43749 (local address 127.24.205.130:33913)
0810 01:36:51.586268 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.586312 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.587139 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.588062 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.588095 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.588596 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:51.589303 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.589330 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.590218 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.590224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.591836 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.591854 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.592595 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.592600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.592799 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.593454 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:51.593480 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:51.595413 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:51.597298 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.597306 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.597325 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.597666 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.597979 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.597983 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.597985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.598130 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.598540 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:51.598547 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:51.598792 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.598982 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.599315 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":141,"threads_started":1}
I20260810 01:36:51.601369 28730 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43749
I20260810 01:36:51.601511 28730 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:51.602089 28730 heartbeater.cc:511] Master 127.24.205.190:43749 requested a full tablet report, sending...
I20260810 01:36:51.603338 28180 ts_manager.cc:194] Registered new tserver with Master: 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533)
I20260810 01:36:51.604218 28180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:33913
I20260810 01:36:51.606037 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28519
I20260810 01:36:51.606150 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:36:51.606451 25398 external_mini_cluster.cc:1428] Setting key a21a0d246363f6daa38b8d03e051c358
I20260810 01:36:51.611745 28741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.603773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43749 (local address 127.24.205.130:58775)
0810 01:36:51.604479 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.604495 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.604626 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.604871 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.604874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.605116 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:51.605259 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.605267 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.606020 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.606023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.606727 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.606736 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.607325 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.607329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.607425 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.607975 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:51.607986 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:51.608400 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:51.610196 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.610198 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.610200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.610405 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.610719 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.610721 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.610723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.610799 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.611306 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:51.611308 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:51.611383 (+ 75us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.611459 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.611561 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":97,"threads_started":1}
I20260810 01:36:51.612198 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.603846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:58775 (local address 127.24.205.190:43749)
0810 01:36:51.603938 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.603942 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.604573 (+ 631us) server_negotiation.cc:407] Connection header received
0810 01:36:51.604730 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.604733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.604772 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.604855 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.605377 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.605894 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.606995 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.607208 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.607312 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.608558 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.608561 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.608564 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.608588 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.610083 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.610501 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.610507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.610512 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.610613 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.610884 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.610888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.610892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.611202 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.611309 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.611545 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.611688 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:36:51.636634 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43749
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:51.758908 28746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:51.759194 28746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:51.759244 28746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:51.763217 28746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:51.763278 28746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:51.763319 28746 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 01:36:51.763332 28746 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:36:51.763365 28746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:36:51.768605 28746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:43749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:51.769690 28746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:51.770747 28746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:51.780608 28756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:51.780608 28755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:51.780609 28760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:51.780905 28746 server_base.cc:1034] running on GCE node
I20260810 01:36:51.781378 28746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:51.782021 28746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:51.783190 28746 hybrid_clock.cc:648] HybridClock initialized: now 1786325811783156 us; error 45 us; skew 500 ppm
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:51.786119 28746 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:36:51.786973 28746 webserver.cc:460] Webserver started at http://127.24.205.131:44637/ using document root <none> and password file <none>
I20260810 01:36:51.787516 28746 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:51.787576 28746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:51.787744 28746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:51.789868 28746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "5c656c46b42546c890f3d9de55c54afe"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "174774701f869ba41c8a6b706dd40082"
server_key_iv: "78e91d4e37366356247f7740ef3c8f86"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.790419 28746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "5c656c46b42546c890f3d9de55c54afe"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "174774701f869ba41c8a6b706dd40082"
server_key_iv: "78e91d4e37366356247f7740ef3c8f86"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.794277 28746 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 01:36:51.796747 28767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:51.797989 28746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:36:51.798116 28746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "5c656c46b42546c890f3d9de55c54afe"
format_stamp: "Formatted at 2026-08-10 01:36:51 on dist-test-slave-t3q3"
server_key: "174774701f869ba41c8a6b706dd40082"
server_key_iv: "78e91d4e37366356247f7740ef3c8f86"
server_key_version: "encryptionkey@0"
I20260810 01:36:51.798239 28746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:51.814182 28746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:51.817729 28746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:51.817953 28746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:51.819464 28746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:51.819514 28746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:51.819554 28746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:51.819607 28746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:51.831321 28746 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:38647
I20260810 01:36:51.831396 28946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:38647 every 8 connection(s)
I20260810 01:36:51.832451 28746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:36:51.834494 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.820724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:33109 (local address 127.24.205.190:43749)
0810 01:36:51.820886 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.820891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.821781 (+ 890us) server_negotiation.cc:407] Connection header received
0810 01:36:51.823163 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.823168 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.823232 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.823341 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.824677 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.825228 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.826551 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.826838 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.826960 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.830644 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.830652 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.830655 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.830679 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.832295 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.832901 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.832905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.832907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.833000 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.833411 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.833415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.833420 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.833617 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.833700 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.834270 (+ 570us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.834374 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:36:51.835299 28786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.821115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43749 (local address 127.24.205.131:33109)
0810 01:36:51.821606 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.821667 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.822878 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.823546 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.823555 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.823995 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:51.824528 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.824542 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.825357 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.825360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.826423 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.826432 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.827016 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.827020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.827231 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.827883 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:51.827899 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:51.830465 (+ 2566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:51.832414 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.832420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.832436 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.832797 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.833139 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.833142 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.833143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.833277 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.833727 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:51.833733 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:51.834016 (+ 283us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.834217 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.834485 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":112,"threads_started":1}
I20260810 01:36:51.836251 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28746
I20260810 01:36:51.836388 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:36:51.836648 28947 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43749
I20260810 01:36:51.836755 25398 external_mini_cluster.cc:1428] Setting key 3d6d5e5a35acb18e36a0415a47fe2aa8
I20260810 01:36:51.836786 28947 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:51.837350 28947 heartbeater.cc:511] Master 127.24.205.190:43749 requested a full tablet report, sending...
I20260810 01:36:51.838425 28180 ts_manager.cc:194] Registered new tserver with Master: 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:51.839157 28180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:33109
I20260810 01:36:51.839264 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:36:51.848836 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.839133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:51865 (local address 127.24.205.190:43749)
0810 01:36:51.839260 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.839265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.839696 (+ 431us) server_negotiation.cc:407] Connection header received
0810 01:36:51.841196 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.841202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.841263 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.841349 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.841897 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.842402 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.843557 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.843954 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.844111 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.845314 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.845321 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.845325 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.845355 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.846868 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.847442 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.847448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.847451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.847571 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.847901 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.847906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.847908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.848170 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.848287 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.848546 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.848675 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:36:51.848843 28956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.839270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43749 (local address 127.24.205.131:51865)
0810 01:36:51.839598 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.839613 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.841075 (+ 1462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.841381 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.841383 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.841619 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:51.841770 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.841781 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.842530 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.842535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.843413 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.843424 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.844127 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.844131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.844224 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.844740 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:51.844752 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:51.845166 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:51.847006 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.847012 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.847017 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.847306 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.847692 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:51.847694 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:51.847696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:51.847783 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:51.848288 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:51.848292 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:51.848382 (+ 90us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.848489 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.848640 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":91,"threads_started":1}
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:51.868592 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.860574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.24.205.190:43749)
0810 01:36:51.860697 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.860701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.860712 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:36:51.860749 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.860751 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.860788 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.860876 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.861612 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.862129 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.862982 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.863206 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.863308 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.865709 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.865712 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.865714 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.865737 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:51.866933 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.867356 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.867365 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.867366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.867439 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:51.867711 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:51.867715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:51.867717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:51.867894 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:51.868032 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.868299 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.868415 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:36:51.871553 28180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:36:51.874727 28180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:51.890151 28981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.883748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53952 (local address 127.24.205.131:38647)
0810 01:36:51.884120 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.884139 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.884849 (+ 710us) server_negotiation.cc:407] Connection header received
0810 01:36:51.885081 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.885088 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.885329 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.885507 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:51.885831 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.887069 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.888590 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.889391 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.889549 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.889709 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.889859 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.889966 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":146,"threads_started":1}
I20260810 01:36:51.890261 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.884617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49842 (local address 127.24.205.129:44015)
0810 01:36:51.884909 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.884918 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.884944 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:36:51.885752 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.885760 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.885934 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.886086 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:51.886347 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.887074 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.888866 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.889699 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.889835 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.889968 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.890026 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.890115 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":117,"threads_started":1}
I20260810 01:36:51.890291 28982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.883652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.0.0.1:49842)
0810 01:36:51.884695 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.884754 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.884911 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.886065 (+ 1154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.886068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.886088 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:51.886199 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.886207 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.887193 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.887199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.888703 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.888716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.889815 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.889821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.889913 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.889936 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.889996 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.890127 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"mutex_wait_us":43,"thread_start_us":95,"threads_started":1}
I20260810 01:36:51.890587 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.883638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:38647 (local address 127.0.0.1:53952)
0810 01:36:51.884695 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.884754 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.884911 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.885500 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.885506 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.885531 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:51.885677 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.885684 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.887213 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.887216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.888461 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.888470 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.889517 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.889522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.889638 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.889678 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.890382 (+ 704us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.890462 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"mutex_wait_us":58,"thread_start_us":103,"threads_started":1}
I20260810 01:36:51.890812 28973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.884456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:46533 (local address 127.0.0.1:47276)
0810 01:36:51.885144 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.885155 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.885249 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.886007 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.886010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.886027 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:51.886121 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.886127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.887416 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.887421 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.888707 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.888723 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.890431 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.890434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.890515 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.890535 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.890626 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.890705 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":76,"thread_start_us":113,"threads_started":1}
I20260810 01:36:51.891167 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.885026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47276 (local address 127.24.205.130:46533)
0810 01:36:51.885378 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.885388 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.885406 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:36:51.885496 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.885501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.885698 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.885853 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:51.886257 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.887306 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.888859 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.889694 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.889846 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.889968 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.890924 (+ 956us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.891029 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":122,"threads_started":1}
I20260810 01:36:51.894059 28845 tablet_service.cc:1467] Processing CreateTablet for tablet ec326699c28d40c7b72f4903389f86f6 (DEFAULT_TABLE table=test-table [id=7a21342802554dbfb48d0ca2a1bb12b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:51.894320 28622 tablet_service.cc:1467] Processing CreateTablet for tablet ec326699c28d40c7b72f4903389f86f6 (DEFAULT_TABLE table=test-table [id=7a21342802554dbfb48d0ca2a1bb12b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:51.895143 28845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec326699c28d40c7b72f4903389f86f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:51.895278 28622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec326699c28d40c7b72f4903389f86f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:51.902194 28403 tablet_service.cc:1467] Processing CreateTablet for tablet ec326699c28d40c7b72f4903389f86f6 (DEFAULT_TABLE table=test-table [id=7a21342802554dbfb48d0ca2a1bb12b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:51.902891 28985 tablet_bootstrap.cc:492] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Bootstrap starting.
I20260810 01:36:51.903378 28403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec326699c28d40c7b72f4903389f86f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:51.905105 28985 tablet_bootstrap.cc:654] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:51.905782 28985 log.cc:824] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:51.907794 28985 tablet_bootstrap.cc:492] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: No bootstrap required, opened a new log
I20260810 01:36:51.907948 28985 ts_tablet_manager.cc:1397] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:36:51.908581 28988 tablet_bootstrap.cc:492] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Bootstrap starting.
I20260810 01:36:51.910105 28994 tablet_bootstrap.cc:492] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Bootstrap starting.
I20260810 01:36:51.910989 28988 tablet_bootstrap.cc:654] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:51.911883 28988 log.cc:824] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:51.912150 28994 tablet_bootstrap.cc:654] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:51.912032 28985 raft_consensus.cc:348] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.912369 28985 raft_consensus.cc:374] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:51.912456 28985 raft_consensus.cc:729] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Initialized, Role: FOLLOWER
I20260810 01:36:51.913022 28994 log.cc:824] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:51.912953 28985 consensus_queue.cc:260] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.913805 28730 heartbeater.cc:503] Master 127.24.205.190:43749 was elected leader, sending a full tablet report...
I20260810 01:36:51.914036 28985 ts_tablet_manager.cc:1428] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:36:51.914662 28988 tablet_bootstrap.cc:492] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: No bootstrap required, opened a new log
I20260810 01:36:51.914868 28988 ts_tablet_manager.cc:1397] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 01:36:51.915664 28994 tablet_bootstrap.cc:492] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: No bootstrap required, opened a new log
I20260810 01:36:51.915875 28994 ts_tablet_manager.cc:1397] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260810 01:36:51.918391 28988 raft_consensus.cc:348] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.918635 28988 raft_consensus.cc:374] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:51.918697 28988 raft_consensus.cc:729] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c656c46b42546c890f3d9de55c54afe, State: Initialized, Role: FOLLOWER
I20260810 01:36:51.919205 28988 consensus_queue.cc:260] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.919898 28947 heartbeater.cc:503] Master 127.24.205.190:43749 was elected leader, sending a full tablet report...
I20260810 01:36:51.920177 28988 ts_tablet_manager.cc:1428] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
I20260810 01:36:51.920176 28994 raft_consensus.cc:348] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.920454 28994 raft_consensus.cc:374] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:51.920512 28994 raft_consensus.cc:729] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8aaf709be804d6fa0cba0b167a0c134, State: Initialized, Role: FOLLOWER
I20260810 01:36:51.920881 28994 consensus_queue.cc:260] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.921590 28503 heartbeater.cc:503] Master 127.24.205.190:43749 was elected leader, sending a full tablet report...
I20260810 01:36:51.921815 28994 ts_tablet_manager.cc:1428] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:36:51.933226 28996 raft_consensus.cc:482] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:51.933467 28996 raft_consensus.cc:504] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.934644 28996 leader_election.cc:288] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647), d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015)
I20260810 01:36:51.938575 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.934888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.24.205.130:45059)
0810 01:36:51.935127 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.935144 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.935267 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.935540 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.935546 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.935564 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:51.935690 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.935700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.936519 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.936522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.937553 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.937564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.938211 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.938218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.938332 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.938352 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.938411 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.938468 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165}
I20260810 01:36:51.938645 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.934987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:45059 (local address 127.24.205.129:44015)
0810 01:36:51.935125 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.935129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.935232 (+ 103us) server_negotiation.cc:407] Connection header received
0810 01:36:51.935365 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.935367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.935424 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.935532 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:51.935808 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.936413 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.937671 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.938104 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.938218 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.938281 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.938450 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.938523 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:36:51.939424 28981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.934975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:51891 (local address 127.24.205.131:38647)
0810 01:36:51.935127 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.935131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.935448 (+ 317us) server_negotiation.cc:407] Connection header received
0810 01:36:51.935578 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.935581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.935632 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.935707 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:51.936423 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.937027 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.938271 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.938871 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.939020 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.939074 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:51.939276 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 01:36:51.939337 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:36:51.939394 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec326699c28d40c7b72f4903389f86f6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aaf709be804d6fa0cba0b167a0c134" is_pre_election: true
I20260810 01:36:51.939517 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.934888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:38647 (local address 127.24.205.130:51891)
0810 01:36:51.935341 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.935356 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.935446 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.935733 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.935739 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.935760 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:51.936306 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.936314 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.937148 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.937152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.938122 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.938132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.939041 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.939048 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.939149 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.939175 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:36:51.939255 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 01:36:51.939317 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":33,"thread_start_us":132,"threads_started":1}
I20260810 01:36:51.939741 28430 raft_consensus.cc:2454] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 0.
I20260810 01:36:51.940263 28551 leader_election.cc:302] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:51.940485 28878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec326699c28d40c7b72f4903389f86f6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe" is_pre_election: true
I20260810 01:36:51.940539 28996 raft_consensus.cc:2781] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:51.940629 28996 raft_consensus.cc:482] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:51.940682 28996 raft_consensus.cc:3037] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:51.940766 28878 raft_consensus.cc:2454] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 0.
I20260810 01:36:51.941875 28996 raft_consensus.cc:504] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.942250 28996 leader_election.cc:288] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 election: Requested vote from peers 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647), d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015)
I20260810 01:36:51.942605 28878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec326699c28d40c7b72f4903389f86f6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe"
I20260810 01:36:51.942618 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec326699c28d40c7b72f4903389f86f6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aaf709be804d6fa0cba0b167a0c134"
I20260810 01:36:51.942734 28878 raft_consensus.cc:3037] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:51.942744 28430 raft_consensus.cc:3037] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:51.943779 28430 raft_consensus.cc:2454] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 1.
I20260810 01:36:51.943796 28878 raft_consensus.cc:2454] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 1.
I20260810 01:36:51.944116 28551 leader_election.cc:302] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:51.944294 28996 raft_consensus.cc:2781] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:51.944535 28996 raft_consensus.cc:686] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 LEADER]: Becoming Leader. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Running, Role: LEADER
I20260810 01:36:51.944859 28996 consensus_queue.cc:237] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } }
I20260810 01:36:51.948196 28180 catalog_manager.cc:5495] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "93b7785b10fe4533b7e505d3bf801d10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } health_report { overall_health: HEALTHY } } }
Aug 10 01:36:51 dist-test-slave-t3q3 krb5kdc[28103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325811, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:52.002792 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.993997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43749 (local address 127.0.0.1:57582)
0810 01:36:51.994412 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:51.994424 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:51.994535 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:51.994775 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:51.994778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:51.995185 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:51.995302 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.995308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.996119 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.996121 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.996690 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:51.996698 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.997137 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.997140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:51.997207 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.997837 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:51.997850 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:51.999353 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:52.001039 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:52.001049 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:52.001054 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:52.001294 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:52.001548 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:52.001550 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:52.001551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:52.001629 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:52.002086 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:52.002094 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:52.002250 (+ 156us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.002392 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.002564 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":265,"threads_started":1}
I20260810 01:36:52.002791 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:51.994119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57582 (local address 127.24.205.190:43749)
0810 01:36:51.994258 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:51.994262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:51.994515 (+ 253us) server_negotiation.cc:407] Connection header received
0810 01:36:51.994612 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:51.994615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:51.994658 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:51.994730 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:51.995423 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.995978 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.996794 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:51.997022 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:51.997106 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:51.999493 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:51.999496 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:51.999498 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:51.999521 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:52.000943 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:52.001378 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:52.001380 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:52.001382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:52.001459 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:52.001685 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:52.001687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:52.001688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:52.001934 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:52.002076 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.002454 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.002619 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":54}
I20260810 01:36:52.006974 28180 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:57582:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 01:36:52.007761 28180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:52.012650 28403 tablet_service.cc:1467] Processing CreateTablet for tablet ee9adb3bafa24e7aa5c2ea486c2bde54 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ad56961bf25a43b697f267742744f0c8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:36:52.012655 28622 tablet_service.cc:1467] Processing CreateTablet for tablet ee9adb3bafa24e7aa5c2ea486c2bde54 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ad56961bf25a43b697f267742744f0c8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:36:52.013048 28845 tablet_service.cc:1467] Processing CreateTablet for tablet ee9adb3bafa24e7aa5c2ea486c2bde54 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ad56961bf25a43b697f267742744f0c8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:36:52.013447 28403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee9adb3bafa24e7aa5c2ea486c2bde54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:52.013447 28622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee9adb3bafa24e7aa5c2ea486c2bde54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:52.013710 28845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee9adb3bafa24e7aa5c2ea486c2bde54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:52.016106 28988 tablet_bootstrap.cc:492] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: Bootstrap starting.
I20260810 01:36:52.016350 28985 tablet_bootstrap.cc:492] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: Bootstrap starting.
I20260810 01:36:52.016350 28994 tablet_bootstrap.cc:492] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: Bootstrap starting.
I20260810 01:36:52.016974 28988 tablet_bootstrap.cc:654] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:52.017341 28985 tablet_bootstrap.cc:654] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:52.017342 28994 tablet_bootstrap.cc:654] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:52.018532 28988 tablet_bootstrap.cc:492] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: No bootstrap required, opened a new log
I20260810 01:36:52.018638 28988 ts_tablet_manager.cc:1397] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:52.018774 28994 tablet_bootstrap.cc:492] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: No bootstrap required, opened a new log
I20260810 01:36:52.018857 28994 ts_tablet_manager.cc:1397] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:36:52.019049 28988 raft_consensus.cc:348] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.019140 28988 raft_consensus.cc:374] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:52.019160 28988 raft_consensus.cc:729] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c656c46b42546c890f3d9de55c54afe, State: Initialized, Role: FOLLOWER
I20260810 01:36:52.019160 28985 tablet_bootstrap.cc:492] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: No bootstrap required, opened a new log
I20260810 01:36:52.019248 28985 ts_tablet_manager.cc:1397] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:52.019292 28988 consensus_queue.cc:260] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.019330 28994 raft_consensus.cc:348] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.019444 28994 raft_consensus.cc:374] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:52.019474 28994 raft_consensus.cc:729] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8aaf709be804d6fa0cba0b167a0c134, State: Initialized, Role: FOLLOWER
I20260810 01:36:52.019572 28988 ts_tablet_manager.cc:1428] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:36:52.019542 28998 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.019593 28994 consensus_queue.cc:260] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.019675 28998 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:52.019690 28985 raft_consensus.cc:348] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.019793 28985 raft_consensus.cc:374] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:52.019827 28985 raft_consensus.cc:729] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Initialized, Role: FOLLOWER
I20260810 01:36:52.019871 28994 ts_tablet_manager.cc:1428] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:52.019948 28985 consensus_queue.cc:260] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.020147 28999 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.020205 28996 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.020296 28999 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:52.020314 28996 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:52.021001 28985 ts_tablet_manager.cc:1428] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260810 01:36:52.083853 28950 tablet.cc:2369] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:36:52.098181 28731 tablet.cc:2369] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:36:52.111243 28999 raft_consensus.cc:482] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:52.111387 28999 raft_consensus.cc:504] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.112813 28999 leader_election.cc:288] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:52.117449 28981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.113406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:56711 (local address 127.24.205.131:38647)
0810 01:36:52.113573 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.113577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.113595 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:36:52.113739 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.113742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.113794 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.113880 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:52.114391 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.115114 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.116277 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.116895 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.116988 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.117029 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.117268 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.117328 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:36:52.117491 29018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.113147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:38647 (local address 127.24.205.129:56711)
0810 01:36:52.113507 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:52.113521 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:52.113623 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:52.113905 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:52.113908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:52.113935 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:52.114185 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.114193 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.115219 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.115223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.116152 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.116162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.117020 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.117024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.117131 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.117158 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.117233 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.117302 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":52,"spinlock_wait_cycles":27520,"thread_start_us":119,"threads_started":1}
I20260810 01:36:52.117972 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.113151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:34477 (local address 127.24.205.130:46533)
0810 01:36:52.113308 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.113315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.113567 (+ 252us) server_negotiation.cc:407] Connection header received
0810 01:36:52.113739 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.113742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.113794 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.113880 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:52.114316 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.115020 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.116788 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.117373 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.117492 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.117549 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.117777 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.117863 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 01:36:52.117975 28878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9adb3bafa24e7aa5c2ea486c2bde54" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe" is_pre_election: true
I20260810 01:36:52.118149 28878 raft_consensus.cc:2454] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 0.
I20260810 01:36:52.118366 29017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.113052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:46533 (local address 127.24.205.129:34477)
0810 01:36:52.113463 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:52.113478 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:52.113623 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:52.113905 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:52.113908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:52.113935 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:52.114185 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.114193 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.115148 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.115154 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.116667 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.116679 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.117504 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.117508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.117614 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.117646 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.118119 (+ 473us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.118198 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":53,"spinlock_wait_cycles":19072,"thread_start_us":130,"threads_started":1}
I20260810 01:36:52.118521 28312 leader_election.cc:302] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c656c46b42546c890f3d9de55c54afe, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:52.118835 28999 raft_consensus.cc:2781] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:52.118914 28999 raft_consensus.cc:482] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:52.118965 28999 raft_consensus.cc:3037] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:52.118932 28653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9adb3bafa24e7aa5c2ea486c2bde54" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b7785b10fe4533b7e505d3bf801d10" is_pre_election: true
I20260810 01:36:52.119127 28653 raft_consensus.cc:2454] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 0.
I20260810 01:36:52.120167 28999 raft_consensus.cc:504] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.120519 28999 leader_election.cc:288] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 election: Requested vote from peers 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:52.120873 28653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9adb3bafa24e7aa5c2ea486c2bde54" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b7785b10fe4533b7e505d3bf801d10"
I20260810 01:36:52.120874 28878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9adb3bafa24e7aa5c2ea486c2bde54" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe"
I20260810 01:36:52.121001 28653 raft_consensus.cc:3037] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:52.121001 28878 raft_consensus.cc:3037] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:52.122159 28653 raft_consensus.cc:2454] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 1.
I20260810 01:36:52.122159 28878 raft_consensus.cc:2454] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 1.
I20260810 01:36:52.122442 28312 leader_election.cc:302] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5c656c46b42546c890f3d9de55c54afe, 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:52.122591 28999 raft_consensus.cc:2781] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:52.122820 28999 raft_consensus.cc:686] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 LEADER]: Becoming Leader. State: Replica: d8aaf709be804d6fa0cba0b167a0c134, State: Running, Role: LEADER
I20260810 01:36:52.123163 28999 consensus_queue.cc:237] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
W20260810 01:36:52.125262 28504 tablet.cc:2369] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:36:52.125671 29019 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: TxnStatusTablet state changed. Reason: New leader d8aaf709be804d6fa0cba0b167a0c134. Latest consensus state: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.125805 29019 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:36:52.126097 29022 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 01:36:52.126305 29022 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 01:36:52.126910 28177 catalog_manager.cc:5495] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } health_report { overall_health: UNKNOWN } } }
I20260810 01:36:52.149688 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.145478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49856 (local address 127.24.205.129:44015)
0810 01:36:52.145613 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.145618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.145691 (+ 73us) server_negotiation.cc:407] Connection header received
0810 01:36:52.145904 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.145907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.145976 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.146088 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:52.146322 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.147132 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.147953 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.148330 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.148434 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.148778 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:52.149319 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:52.149433 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.149493 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.149551 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:36:52.149672 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.145379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.0.0.1:49856)
0810 01:36:52.145595 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:52.145614 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:52.145753 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:52.146112 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:52.146114 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:52.146120 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:36:52.146219 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.146225 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.147234 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.147236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.147843 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.147851 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.148434 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.148437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.148524 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.148571 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:36:52.149409 (+ 838us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:36:52.149423 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.149481 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.149557 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260810 01:36:52.154964 28653 raft_consensus.cc:1261] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Refusing update from remote peer d8aaf709be804d6fa0cba0b167a0c134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:52.154995 28878 raft_consensus.cc:1261] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Refusing update from remote peer d8aaf709be804d6fa0cba0b167a0c134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:52.155716 28999 consensus_queue.cc:1035] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:52.155987 29019 consensus_queue.cc:1035] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:52.159504 28996 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: TxnStatusTablet state changed. Reason: New leader d8aaf709be804d6fa0cba0b167a0c134. Latest consensus state: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.159631 28996 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:52.161466 28998 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: TxnStatusTablet state changed. Reason: New leader d8aaf709be804d6fa0cba0b167a0c134. Latest consensus state: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.161619 28998 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:52.162690 28999 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.162803 28999 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:36:52.163472 28998 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.163581 28998 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 5c656c46b42546c890f3d9de55c54afe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:52.164844 29026 mvcc.cc:205] Tried to move back new op lower bound from 7316790526579580928 to 7316790526459088896. Current Snapshot: MvccSnapshot[applied={T|T < 7316790526579580928}]
I20260810 01:36:52.164990 29032 mvcc.cc:205] Tried to move back new op lower bound from 7316790526579580928 to 7316790526459088896. Current Snapshot: MvccSnapshot[applied={T|T < 7316790526579580928}]
I20260810 01:36:52.169445 29019 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.169569 29019 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P d8aaf709be804d6fa0cba0b167a0c134: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:36:52.171325 29029 mvcc.cc:205] Tried to move back new op lower bound from 7316790526579580928 to 7316790526459088896. Current Snapshot: MvccSnapshot[applied={T|T < 7316790526579580928}]
I20260810 01:36:52.171519 28996 tablet_replica.cc:439] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } } }
I20260810 01:36:52.171633 28996 tablet_replica.cc:442] T ee9adb3bafa24e7aa5c2ea486c2bde54 P 93b7785b10fe4533b7e505d3bf801d10: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:36:52.175868 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.172303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47292 (local address 127.24.205.130:46533)
0810 01:36:52.172455 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.172459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.172471 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:36:52.172536 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.172539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.172594 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.172692 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:52.172963 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.173475 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.174469 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.174699 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.174812 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.175081 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:52.175485 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:52.175610 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.175676 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.175732 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 01:36:52.187273 29049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.183132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.24.205.130:51597)
0810 01:36:52.183443 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:52.183456 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:52.183547 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:52.183887 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:52.183890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:52.183898 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:36:52.184011 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.184015 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.185126 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.185129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.185744 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.185752 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.186343 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.186346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.186413 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.186457 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:36:52.186898 (+ 441us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:36:52.186903 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.186983 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.187082 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":113,"threads_started":1}
I20260810 01:36:52.187301 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.183254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:51597 (local address 127.24.205.129:44015)
0810 01:36:52.183388 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.183393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.183526 (+ 133us) server_negotiation.cc:407] Connection header received
0810 01:36:52.183692 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.183695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.183752 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.183853 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:52.184180 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.184987 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.185857 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.186209 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.186317 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.186665 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:52.186807 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:52.186898 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.187004 (+ 106us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.187088 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:36:52.199087 28878 raft_consensus.cc:1261] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Refusing update from remote peer 93b7785b10fe4533b7e505d3bf801d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:52.199559 28430 raft_consensus.cc:1261] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Refusing update from remote peer 93b7785b10fe4533b7e505d3bf801d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:52.199803 28996 consensus_queue.cc:1035] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:52.200419 28996 consensus_queue.cc:1035] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:52.242107 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.236249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:48135 (local address 127.24.205.130:46533)
0810 01:36:52.236439 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.236450 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.236480 (+ 30us) server_negotiation.cc:407] Connection header received
0810 01:36:52.236781 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.236785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.236881 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.237016 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:52.237541 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.238626 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.240263 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.240762 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.240929 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.241383 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:52.241513 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:52.241633 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.241816 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.241905 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 01:36:52.242550 29056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.235763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:46533 (local address 127.24.205.129:48135)
0810 01:36:52.236344 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:52.236375 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:52.236586 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:52.237041 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:52.237046 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:52.237062 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:36:52.237302 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.237333 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.238799 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.238807 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.240024 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.240040 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.241004 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.241012 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.241120 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.241197 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:36:52.241655 (+ 458us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:36:52.241668 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.241800 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.241946 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":152,"threads_started":1}
I20260810 01:36:52.284849 28181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:52.285250 28181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:52.290958 28181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Sending DeleteTablet for 3 replicas of tablet ec326699c28d40c7b72f4903389f86f6
I20260810 01:36:52.292512 28845 tablet_service.cc:1514] Processing DeleteTablet for tablet ec326699c28d40c7b72f4903389f86f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:52 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:53952
I20260810 01:36:52.292649 28403 tablet_service.cc:1514] Processing DeleteTablet for tablet ec326699c28d40c7b72f4903389f86f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:52 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:49842
I20260810 01:36:52.293825 29060 tablet_replica.cc:330] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: stopping tablet replica
I20260810 01:36:52.294538 29060 raft_consensus.cc:2229] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:52.294533 28622 tablet_service.cc:1514] Processing DeleteTablet for tablet ec326699c28d40c7b72f4903389f86f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:52 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:47276
I20260810 01:36:52.295017 29060 raft_consensus.cc:2258] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:52.295884 29063 tablet_replica.cc:330] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: stopping tablet replica
I20260810 01:36:52.296406 29063 raft_consensus.cc:2229] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:36:52.297039 29063 raft_consensus.cc:2258] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:52.297199 28177 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:36:52.297616 29061 tablet_replica.cc:330] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: stopping tablet replica
W20260810 01:36:52.297988 28177 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:52.298069 29061 raft_consensus.cc:2229] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:52.298321 29061 raft_consensus.cc:2258] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:52.303158 29063 ts_tablet_manager.cc:1905] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:52.303457 29060 ts_tablet_manager.cc:1905] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:52.304306 29061 ts_tablet_manager.cc:1905] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:52.309432 28622 tablet_service.cc:1467] Processing CreateTablet for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa (DEFAULT_TABLE table=test-table [id=f92c8fbaeff146cda7b89407d24dec88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:52.309960 28622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:52.310933 29060 ts_tablet_manager.cc:1918] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:52.311128 29060 log.cc:1196] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/ec326699c28d40c7b72f4903389f86f6
I20260810 01:36:52.311743 29060 ts_tablet_manager.cc:1939] T ec326699c28d40c7b72f4903389f86f6 P 5c656c46b42546c890f3d9de55c54afe: Deleting consensus metadata
I20260810 01:36:52.314085 28152 catalog_manager.cc:4841] TS 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647): tablet ec326699c28d40c7b72f4903389f86f6 (table test-table [id=7a21342802554dbfb48d0ca2a1bb12b0]) successfully deleted
I20260810 01:36:52.314415 29063 ts_tablet_manager.cc:1918] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:52.314710 29063 log.cc:1196] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/ec326699c28d40c7b72f4903389f86f6
I20260810 01:36:52.315459 29063 ts_tablet_manager.cc:1939] T ec326699c28d40c7b72f4903389f86f6 P 93b7785b10fe4533b7e505d3bf801d10: Deleting consensus metadata
I20260810 01:36:52.315420 28845 tablet_service.cc:1467] Processing CreateTablet for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa (DEFAULT_TABLE table=test-table [id=f92c8fbaeff146cda7b89407d24dec88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:52.315884 28845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:52.319033 29061 ts_tablet_manager.cc:1918] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:52.319211 29061 log.cc:1196] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/ec326699c28d40c7b72f4903389f86f6
I20260810 01:36:52.319890 29061 ts_tablet_manager.cc:1939] T ec326699c28d40c7b72f4903389f86f6 P d8aaf709be804d6fa0cba0b167a0c134: Deleting consensus metadata
I20260810 01:36:52.321746 28160 catalog_manager.cc:4841] TS 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533): tablet ec326699c28d40c7b72f4903389f86f6 (table test-table [id=7a21342802554dbfb48d0ca2a1bb12b0]) successfully deleted
I20260810 01:36:52.322261 28160 catalog_manager.cc:4841] TS d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015): tablet ec326699c28d40c7b72f4903389f86f6 (table test-table [id=7a21342802554dbfb48d0ca2a1bb12b0]) successfully deleted
I20260810 01:36:52.322741 28403 tablet_service.cc:1467] Processing CreateTablet for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa (DEFAULT_TABLE table=test-table [id=f92c8fbaeff146cda7b89407d24dec88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:52.323213 28403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:52.327512 28994 tablet_bootstrap.cc:492] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: Bootstrap starting.
I20260810 01:36:52.328315 28988 tablet_bootstrap.cc:492] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: Bootstrap starting.
I20260810 01:36:52.329941 28994 tablet_bootstrap.cc:654] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:52.330094 28988 tablet_bootstrap.cc:654] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:52.331207 28985 tablet_bootstrap.cc:492] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: Bootstrap starting.
I20260810 01:36:52.332397 28988 tablet_bootstrap.cc:492] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: No bootstrap required, opened a new log
I20260810 01:36:52.332544 28988 ts_tablet_manager.cc:1397] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:36:52.333057 28985 tablet_bootstrap.cc:654] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:52.333451 28988 raft_consensus.cc:348] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.333678 28988 raft_consensus.cc:374] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:52.333763 28988 raft_consensus.cc:729] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c656c46b42546c890f3d9de55c54afe, State: Initialized, Role: FOLLOWER
I20260810 01:36:52.334077 28988 consensus_queue.cc:260] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.336930 28985 tablet_bootstrap.cc:492] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: No bootstrap required, opened a new log
I20260810 01:36:52.337124 28985 ts_tablet_manager.cc:1397] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260810 01:36:52.338024 28985 raft_consensus.cc:348] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.338285 28985 raft_consensus.cc:374] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:52.338369 28985 raft_consensus.cc:729] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Initialized, Role: FOLLOWER
I20260810 01:36:52.338688 28985 consensus_queue.cc:260] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.340431 28988 ts_tablet_manager.cc:1428] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 01:36:52.342381 28985 ts_tablet_manager.cc:1428] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260810 01:36:52.346334 28994 tablet_bootstrap.cc:492] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: No bootstrap required, opened a new log
I20260810 01:36:52.346560 28994 ts_tablet_manager.cc:1397] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.000s
I20260810 01:36:52.347506 28994 raft_consensus.cc:348] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.347779 28994 raft_consensus.cc:374] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:52.347854 28994 raft_consensus.cc:729] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8aaf709be804d6fa0cba0b167a0c134, State: Initialized, Role: FOLLOWER
I20260810 01:36:52.348263 28994 consensus_queue.cc:260] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.348905 28994 ts_tablet_manager.cc:1428] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:36:52.373409 28996 raft_consensus.cc:482] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:52.373669 28996 raft_consensus.cc:504] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.374742 28996 leader_election.cc:288] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:52.377588 28998 raft_consensus.cc:482] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:52.377810 28998 raft_consensus.cc:504] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.379915 28998 leader_election.cc:288] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015), 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533)
I20260810 01:36:52.375993 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b3b3cdaa6e4494948381ae0cc6f6aa" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aaf709be804d6fa0cba0b167a0c134" is_pre_election: true
I20260810 01:36:52.382673 28430 raft_consensus.cc:2454] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 0.
I20260810 01:36:52.383287 28551 leader_election.cc:302] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:52.383936 28878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b3b3cdaa6e4494948381ae0cc6f6aa" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe" is_pre_election: true
I20260810 01:36:52.384196 28878 raft_consensus.cc:2454] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 0.
I20260810 01:36:52.384883 28996 raft_consensus.cc:2781] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:52.385021 28996 raft_consensus.cc:482] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:52.385100 28996 raft_consensus.cc:3037] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:52.386931 28996 raft_consensus.cc:504] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.388092 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b3b3cdaa6e4494948381ae0cc6f6aa" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aaf709be804d6fa0cba0b167a0c134"
I20260810 01:36:52.388306 28430 raft_consensus.cc:3037] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:52.390240 28430 raft_consensus.cc:2454] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 1.
I20260810 01:36:52.390807 28551 leader_election.cc:302] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:52.391117 29053 raft_consensus.cc:2781] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:52.391263 29053 raft_consensus.cc:686] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 1 LEADER]: Becoming Leader. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Running, Role: LEADER
I20260810 01:36:52.391543 29053 consensus_queue.cc:237] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:52.395062 28177 catalog_manager.cc:5495] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "93b7785b10fe4533b7e505d3bf801d10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } health_report { overall_health: UNKNOWN } } }
I20260810 01:36:52.398013 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.381703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:34415 (local address 127.24.205.129:44015)
0810 01:36:52.381883 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.381887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.384627 (+ 2740us) server_negotiation.cc:407] Connection header received
0810 01:36:52.385211 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.385215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.385301 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.385372 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:52.387317 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.388581 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.395654 (+ 7073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.396667 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.396810 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.396980 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.397699 (+ 719us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.397823 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 01:36:52.398836 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.380542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.24.205.131:34415)
0810 01:36:52.384463 (+ 3921us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:52.384492 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:52.384726 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:52.385678 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:52.385682 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:52.385714 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:52.385864 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.385872 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.388959 (+ 3087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.388962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.392503 (+ 3541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.392516 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.397233 (+ 4717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.397238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.397451 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.397498 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.398437 (+ 939us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.398594 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3800,"thread_start_us":131,"threads_started":1}
I20260810 01:36:52.403856 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b3b3cdaa6e4494948381ae0cc6f6aa" candidate_uuid: "5c656c46b42546c890f3d9de55c54afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aaf709be804d6fa0cba0b167a0c134" is_pre_election: true
I20260810 01:36:52.406862 28430 raft_consensus.cc:2379] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c656c46b42546c890f3d9de55c54afe in current term 1: Already voted for candidate 93b7785b10fe4533b7e505d3bf801d10 in this term.
I20260810 01:36:52.408452 28878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b3b3cdaa6e4494948381ae0cc6f6aa" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe"
I20260810 01:36:52.408716 28878 raft_consensus.cc:3037] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:52.411043 28878 raft_consensus.cc:2454] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 1.
I20260810 01:36:52.411718 28996 leader_election.cc:288] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 election: Requested vote from peers d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:52.418476 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.382030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:48247 (local address 127.24.205.130:46533)
0810 01:36:52.382206 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:52.382216 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:52.399775 (+ 17559us) server_negotiation.cc:407] Connection header received
0810 01:36:52.399871 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:52.399874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:52.399964 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:52.400135 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:36:52.412577 (+ 12442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.413804 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.416278 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.417201 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.417371 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.417448 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:52.418101 (+ 653us) server_negotiation.cc:299] Negotiation successful
0810 01:36:52.418200 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 01:36:52.419148 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:52.381113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:46533 (local address 127.24.205.131:48247)
0810 01:36:52.399505 (+ 18392us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:52.399540 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:52.399678 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:52.412123 (+ 12445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:52.412128 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:52.412167 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:36:52.412353 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.412361 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.414112 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.414117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.415999 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:52.416021 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:52.417631 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:52.417636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:52.417806 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:52.417854 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 01:36:52.418804 (+ 950us) client_negotiation.cc:240] Negotiation successful
0810 01:36:52.418938 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18282,"thread_start_us":86,"threads_started":1}
I20260810 01:36:52.420655 28653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b3b3cdaa6e4494948381ae0cc6f6aa" candidate_uuid: "5c656c46b42546c890f3d9de55c54afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b7785b10fe4533b7e505d3bf801d10" is_pre_election: true
I20260810 01:36:52.421586 28774 leader_election.cc:302] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c656c46b42546c890f3d9de55c54afe; no voters: 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134
I20260810 01:36:52.422605 28998 raft_consensus.cc:2726] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 01:36:52.435622 28876 raft_consensus.cc:1261] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Refusing update from remote peer 93b7785b10fe4533b7e505d3bf801d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:52.435912 28430 raft_consensus.cc:1261] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Refusing update from remote peer 93b7785b10fe4533b7e505d3bf801d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:52.436893 29053 consensus_queue.cc:1035] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:52.437414 29053 consensus_queue.cc:1035] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:36:52.465418 29029 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 01:36:54.057886 28181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:54.058132 28181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:54.061046 28181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Sending DeleteTablet for 3 replicas of tablet f2b3b3cdaa6e4494948381ae0cc6f6aa
I20260810 01:36:54.061710 28403 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:54 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:49842
I20260810 01:36:54.061762 28622 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:54 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:47276
I20260810 01:36:54.061838 28845 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b3b3cdaa6e4494948381ae0cc6f6aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:54 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:53952
I20260810 01:36:54.062115 29115 tablet_replica.cc:330] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: stopping tablet replica
I20260810 01:36:54.062232 29118 tablet_replica.cc:330] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: stopping tablet replica
I20260810 01:36:54.062273 29115 raft_consensus.cc:2229] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:54.062355 29118 raft_consensus.cc:2229] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:36:54.062409 29115 raft_consensus.cc:2258] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:54.062271 29116 tablet_replica.cc:330] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: stopping tablet replica
I20260810 01:36:54.062637 29116 raft_consensus.cc:2229] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:54.062784 29116 raft_consensus.cc:2258] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:54.062812 29118 raft_consensus.cc:2258] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:54.063495 29118 ts_tablet_manager.cc:1905] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:54.063894 29116 ts_tablet_manager.cc:1905] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:54.064023 29115 ts_tablet_manager.cc:1905] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:54.066670 29118 ts_tablet_manager.cc:1918] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:36:54.066768 29118 log.cc:1196] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/f2b3b3cdaa6e4494948381ae0cc6f6aa
I20260810 01:36:54.067127 29118 ts_tablet_manager.cc:1939] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 93b7785b10fe4533b7e505d3bf801d10: Deleting consensus metadata
I20260810 01:36:54.067226 29115 ts_tablet_manager.cc:1918] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:36:54.067310 29115 log.cc:1196] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/f2b3b3cdaa6e4494948381ae0cc6f6aa
I20260810 01:36:54.067370 29116 ts_tablet_manager.cc:1918] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:36:54.067499 29116 log.cc:1196] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/f2b3b3cdaa6e4494948381ae0cc6f6aa
I20260810 01:36:54.067574 29115 ts_tablet_manager.cc:1939] T f2b3b3cdaa6e4494948381ae0cc6f6aa P d8aaf709be804d6fa0cba0b167a0c134: Deleting consensus metadata
I20260810 01:36:54.067826 29116 ts_tablet_manager.cc:1939] T f2b3b3cdaa6e4494948381ae0cc6f6aa P 5c656c46b42546c890f3d9de55c54afe: Deleting consensus metadata
I20260810 01:36:54.068137 28160 catalog_manager.cc:4841] TS 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533): tablet f2b3b3cdaa6e4494948381ae0cc6f6aa (table test-table [id=f92c8fbaeff146cda7b89407d24dec88]) successfully deleted
I20260810 01:36:54.068346 28160 catalog_manager.cc:4841] TS d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015): tablet f2b3b3cdaa6e4494948381ae0cc6f6aa (table test-table [id=f92c8fbaeff146cda7b89407d24dec88]) successfully deleted
I20260810 01:36:54.068615 28152 catalog_manager.cc:4841] TS 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647): tablet f2b3b3cdaa6e4494948381ae0cc6f6aa (table test-table [id=f92c8fbaeff146cda7b89407d24dec88]) successfully deleted
Aug 10 01:36:54 dist-test-slave-t3q3 krb5kdc[28103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325814, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:36:54 dist-test-slave-t3q3 krb5kdc[28103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325814, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:54.096117 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:54.086484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57590 (local address 127.24.205.190:43749)
0810 01:36:54.086843 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:54.086852 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:54.086870 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:36:54.086952 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:54.086955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:54.087004 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:54.087099 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:54.087833 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.088737 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.089602 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.089941 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.090031 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:54.092688 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:54.092691 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:54.092693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:54.092720 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:54.094319 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:54.094796 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:54.094799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:54.094800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:54.094884 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:54.095182 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:54.095184 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:54.095185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:54.095374 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:54.095482 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:54.095711 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 01:36:54.095823 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":133,"threads_started":1}
I20260810 01:36:54.099084 28181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:36:54.099591 28181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:54.105126 28403 tablet_service.cc:1467] Processing CreateTablet for tablet d70bbc0e71a54160b3de7e61e04512f3 (DEFAULT_TABLE table=test-table [id=d104d5875be04a9ba5fe6a4792003aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:54.105201 28622 tablet_service.cc:1467] Processing CreateTablet for tablet d70bbc0e71a54160b3de7e61e04512f3 (DEFAULT_TABLE table=test-table [id=d104d5875be04a9ba5fe6a4792003aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:54.105386 28845 tablet_service.cc:1467] Processing CreateTablet for tablet d70bbc0e71a54160b3de7e61e04512f3 (DEFAULT_TABLE table=test-table [id=d104d5875be04a9ba5fe6a4792003aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:54.105484 28403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d70bbc0e71a54160b3de7e61e04512f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:54.105520 28622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d70bbc0e71a54160b3de7e61e04512f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:54.105665 28845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d70bbc0e71a54160b3de7e61e04512f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:54.107518 29131 tablet_bootstrap.cc:492] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: Bootstrap starting.
I20260810 01:36:54.108192 29133 tablet_bootstrap.cc:492] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: Bootstrap starting.
I20260810 01:36:54.108450 29134 tablet_bootstrap.cc:492] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: Bootstrap starting.
I20260810 01:36:54.108799 29131 tablet_bootstrap.cc:654] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:54.109283 29134 tablet_bootstrap.cc:654] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:54.109338 29133 tablet_bootstrap.cc:654] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:54.110100 29131 tablet_bootstrap.cc:492] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: No bootstrap required, opened a new log
I20260810 01:36:54.110249 29131 ts_tablet_manager.cc:1397] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:54.110535 29134 tablet_bootstrap.cc:492] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: No bootstrap required, opened a new log
I20260810 01:36:54.110627 29134 ts_tablet_manager.cc:1397] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:36:54.110677 29131 raft_consensus.cc:348] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.110781 29131 raft_consensus.cc:374] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:54.110805 29131 raft_consensus.cc:729] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Initialized, Role: FOLLOWER
I20260810 01:36:54.110956 29131 consensus_queue.cc:260] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.111104 29134 raft_consensus.cc:348] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.111224 29134 raft_consensus.cc:374] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:54.111264 29134 raft_consensus.cc:729] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c656c46b42546c890f3d9de55c54afe, State: Initialized, Role: FOLLOWER
I20260810 01:36:54.111259 29131 ts_tablet_manager.cc:1428] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:36:54.111392 29134 consensus_queue.cc:260] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.111786 29134 ts_tablet_manager.cc:1428] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 01:36:54.112571 29133 tablet_bootstrap.cc:492] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: No bootstrap required, opened a new log
I20260810 01:36:54.112753 29133 ts_tablet_manager.cc:1397] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 01:36:54.113212 29133 raft_consensus.cc:348] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.113332 29133 raft_consensus.cc:374] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:54.113377 29133 raft_consensus.cc:729] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8aaf709be804d6fa0cba0b167a0c134, State: Initialized, Role: FOLLOWER
I20260810 01:36:54.113523 29133 consensus_queue.cc:260] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.114235 29133 ts_tablet_manager.cc:1428] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:54.128803 29092 raft_consensus.cc:482] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:54.128921 29092 raft_consensus.cc:504] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.129302 29092 leader_election.cc:288] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:54.129711 28652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70bbc0e71a54160b3de7e61e04512f3" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b7785b10fe4533b7e505d3bf801d10" is_pre_election: true
I20260810 01:36:54.129773 28876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70bbc0e71a54160b3de7e61e04512f3" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe" is_pre_election: true
I20260810 01:36:54.129851 28652 raft_consensus.cc:2454] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 0.
I20260810 01:36:54.129984 28876 raft_consensus.cc:2454] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 0.
I20260810 01:36:54.130216 28317 leader_election.cc:302] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:54.130452 29092 raft_consensus.cc:2781] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:54.130520 29092 raft_consensus.cc:482] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:54.130581 29092 raft_consensus.cc:3037] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:54.131737 29092 raft_consensus.cc:504] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.132150 29092 leader_election.cc:288] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 election: Requested vote from peers 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:54.132493 28652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70bbc0e71a54160b3de7e61e04512f3" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b7785b10fe4533b7e505d3bf801d10"
I20260810 01:36:54.132612 28652 raft_consensus.cc:3037] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:54.132571 28876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70bbc0e71a54160b3de7e61e04512f3" candidate_uuid: "d8aaf709be804d6fa0cba0b167a0c134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe"
I20260810 01:36:54.132725 28876 raft_consensus.cc:3037] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:54.133746 28652 raft_consensus.cc:2454] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 1.
I20260810 01:36:54.133925 28876 raft_consensus.cc:2454] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8aaf709be804d6fa0cba0b167a0c134 in term 1.
I20260810 01:36:54.134068 28317 leader_election.cc:302] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:54.134265 29092 raft_consensus.cc:2781] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:54.134361 29092 raft_consensus.cc:686] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 LEADER]: Becoming Leader. State: Replica: d8aaf709be804d6fa0cba0b167a0c134, State: Running, Role: LEADER
I20260810 01:36:54.134506 29092 consensus_queue.cc:237] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.136197 28181 catalog_manager.cc:5495] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "d8aaf709be804d6fa0cba0b167a0c134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } health_report { overall_health: UNKNOWN } } }
I20260810 01:36:54.160202 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:54.156908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49860 (local address 127.24.205.129:44015)
0810 01:36:54.157177 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:54.157185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:54.157197 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:36:54.157237 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:54.157240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:54.157282 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:54.157352 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:54.157606 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.158135 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.159052 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.159291 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.159374 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:54.159656 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:54.159733 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:54.159791 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:54.159933 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 01:36:54.159980 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":138,"threads_started":1}
I20260810 01:36:54.169430 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:54.166052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.24.205.129:47785)
0810 01:36:54.166353 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:54.166365 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:54.166479 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:54.166709 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:54.166711 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:54.166718 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:36:54.166887 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:54.166893 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.167594 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.167599 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:54.168279 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:54.168289 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.168708 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.168711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:54.168796 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:54.168816 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:36:54.169135 (+ 319us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:36:54.169142 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:36:54.169206 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 01:36:54.169290 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":40,"thread_start_us":120,"threads_started":1}
I20260810 01:36:54.169430 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:54.166172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:47785 (local address 127.24.205.129:44015)
0810 01:36:54.166302 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:54.166306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:54.166434 (+ 128us) server_negotiation.cc:407] Connection header received
0810 01:36:54.166574 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:54.166578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:54.166623 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:54.166700 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:54.166992 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.167483 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.168391 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.168601 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.168706 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:54.168940 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:54.169027 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:54.169135 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:54.169213 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 01:36:54.169267 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":42}
I20260810 01:36:54.175122 28652 raft_consensus.cc:1261] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Refusing update from remote peer d8aaf709be804d6fa0cba0b167a0c134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:54.175127 28876 raft_consensus.cc:1261] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Refusing update from remote peer d8aaf709be804d6fa0cba0b167a0c134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:54.175498 29086 consensus_queue.cc:1035] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:54.175690 29092 consensus_queue.cc:1035] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:54.209700 28181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:54.209889 28181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:54.212021 28181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Sending DeleteTablet for 3 replicas of tablet d70bbc0e71a54160b3de7e61e04512f3
I20260810 01:36:54.212584 28402 tablet_service.cc:1514] Processing DeleteTablet for tablet d70bbc0e71a54160b3de7e61e04512f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:54 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:49842
I20260810 01:36:54.212685 28622 tablet_service.cc:1514] Processing DeleteTablet for tablet d70bbc0e71a54160b3de7e61e04512f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:54 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:47276
I20260810 01:36:54.212792 28845 tablet_service.cc:1514] Processing DeleteTablet for tablet d70bbc0e71a54160b3de7e61e04512f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:54 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:53952
I20260810 01:36:54.212994 29115 tablet_replica.cc:330] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: stopping tablet replica
I20260810 01:36:54.213076 29116 tablet_replica.cc:330] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: stopping tablet replica
I20260810 01:36:54.213126 29115 raft_consensus.cc:2229] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:36:54.213198 29116 raft_consensus.cc:2229] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:54.213318 29116 raft_consensus.cc:2258] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:54.213444 29115 raft_consensus.cc:2258] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:54.213505 29118 tablet_replica.cc:330] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: stopping tablet replica
I20260810 01:36:54.213639 29118 raft_consensus.cc:2229] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:54.213779 29118 raft_consensus.cc:2258] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:54.214005 28181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:36:54.214389 29116 ts_tablet_manager.cc:1905] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:54.214578 29118 ts_tablet_manager.cc:1905] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 01:36:54.214702 28181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:36:54.217111 29116 ts_tablet_manager.cc:1918] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:54.217204 29116 log.cc:1196] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/d70bbc0e71a54160b3de7e61e04512f3
I20260810 01:36:54.217464 29116 ts_tablet_manager.cc:1939] T d70bbc0e71a54160b3de7e61e04512f3 P 5c656c46b42546c890f3d9de55c54afe: Deleting consensus metadata
I20260810 01:36:54.218189 28152 catalog_manager.cc:4841] TS 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647): tablet d70bbc0e71a54160b3de7e61e04512f3 (table test-table [id=d104d5875be04a9ba5fe6a4792003aa8]) successfully deleted
I20260810 01:36:54.218850 29115 ts_tablet_manager.cc:1905] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:54.219702 28402 tablet_service.cc:1467] Processing CreateTablet for tablet 4c8f3ff381fd423b87485276aa9a23e6 (DEFAULT_TABLE table=test-table [id=b7037d9efc6b44a1b7df381cec00e6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:54.219976 28402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c8f3ff381fd423b87485276aa9a23e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:54.220141 29118 ts_tablet_manager.cc:1918] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:54.220223 29118 log.cc:1196] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/d70bbc0e71a54160b3de7e61e04512f3
I20260810 01:36:54.220497 29118 ts_tablet_manager.cc:1939] T d70bbc0e71a54160b3de7e61e04512f3 P 93b7785b10fe4533b7e505d3bf801d10: Deleting consensus metadata
I20260810 01:36:54.220507 28622 tablet_service.cc:1467] Processing CreateTablet for tablet 4c8f3ff381fd423b87485276aa9a23e6 (DEFAULT_TABLE table=test-table [id=b7037d9efc6b44a1b7df381cec00e6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:54.221019 28622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c8f3ff381fd423b87485276aa9a23e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:54.222112 28845 tablet_service.cc:1467] Processing CreateTablet for tablet 4c8f3ff381fd423b87485276aa9a23e6 (DEFAULT_TABLE table=test-table [id=b7037d9efc6b44a1b7df381cec00e6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:36:54.222373 28845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c8f3ff381fd423b87485276aa9a23e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:54.222553 29115 ts_tablet_manager.cc:1918] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:36:54.222622 29115 log.cc:1196] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/d70bbc0e71a54160b3de7e61e04512f3
I20260810 01:36:54.222892 29115 ts_tablet_manager.cc:1939] T d70bbc0e71a54160b3de7e61e04512f3 P d8aaf709be804d6fa0cba0b167a0c134: Deleting consensus metadata
I20260810 01:36:54.223434 29131 tablet_bootstrap.cc:492] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10: Bootstrap starting.
I20260810 01:36:54.224377 29131 tablet_bootstrap.cc:654] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:54.224718 29134 tablet_bootstrap.cc:492] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: Bootstrap starting.
I20260810 01:36:54.225400 28160 catalog_manager.cc:4841] TS d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015): tablet d70bbc0e71a54160b3de7e61e04512f3 (table test-table [id=d104d5875be04a9ba5fe6a4792003aa8]) successfully deleted
I20260810 01:36:54.225610 28160 catalog_manager.cc:4841] TS 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130:46533): tablet d70bbc0e71a54160b3de7e61e04512f3 (table test-table [id=d104d5875be04a9ba5fe6a4792003aa8]) successfully deleted
I20260810 01:36:54.225652 29134 tablet_bootstrap.cc:654] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:54.226326 29133 tablet_bootstrap.cc:492] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134: Bootstrap starting.
I20260810 01:36:54.227136 29133 tablet_bootstrap.cc:654] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:54.227254 29131 tablet_bootstrap.cc:492] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10: No bootstrap required, opened a new log
I20260810 01:36:54.227342 29131 ts_tablet_manager.cc:1397] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 01:36:54.227808 29131 raft_consensus.cc:348] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.227959 29131 raft_consensus.cc:374] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:54.228008 29131 raft_consensus.cc:729] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Initialized, Role: FOLLOWER
I20260810 01:36:54.228024 29134 tablet_bootstrap.cc:492] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: No bootstrap required, opened a new log
I20260810 01:36:54.228148 29134 ts_tablet_manager.cc:1397] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:54.228168 29131 consensus_queue.cc:260] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.228483 29131 ts_tablet_manager.cc:1428] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:54.228750 29134 raft_consensus.cc:348] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.228873 29134 raft_consensus.cc:374] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:54.228911 29134 raft_consensus.cc:729] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c656c46b42546c890f3d9de55c54afe, State: Initialized, Role: FOLLOWER
I20260810 01:36:54.229032 29134 consensus_queue.cc:260] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.229359 29134 ts_tablet_manager.cc:1428] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:54.230111 29133 tablet_bootstrap.cc:492] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134: No bootstrap required, opened a new log
I20260810 01:36:54.230198 29133 ts_tablet_manager.cc:1397] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 01:36:54.230556 29133 raft_consensus.cc:348] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.230654 29133 raft_consensus.cc:374] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:54.230695 29133 raft_consensus.cc:729] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8aaf709be804d6fa0cba0b167a0c134, State: Initialized, Role: FOLLOWER
I20260810 01:36:54.230813 29133 consensus_queue.cc:260] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.231050 29133 ts_tablet_manager.cc:1428] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:36:54.415127 29080 raft_consensus.cc:482] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:36:54.415262 29080 raft_consensus.cc:504] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.415653 29080 leader_election.cc:288] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:54.416145 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c8f3ff381fd423b87485276aa9a23e6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aaf709be804d6fa0cba0b167a0c134" is_pre_election: true
I20260810 01:36:54.416145 28876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c8f3ff381fd423b87485276aa9a23e6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe" is_pre_election: true
I20260810 01:36:54.416323 28430 raft_consensus.cc:2454] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 0.
I20260810 01:36:54.416323 28876 raft_consensus.cc:2454] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 0.
I20260810 01:36:54.416666 28551 leader_election.cc:302] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5c656c46b42546c890f3d9de55c54afe, 93b7785b10fe4533b7e505d3bf801d10, d8aaf709be804d6fa0cba0b167a0c134; no voters:
I20260810 01:36:54.416878 29080 raft_consensus.cc:2781] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:36:54.416951 29080 raft_consensus.cc:482] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:36:54.417009 29080 raft_consensus.cc:3037] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:54.418063 29080 raft_consensus.cc:504] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.418421 29080 leader_election.cc:288] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 election: Requested vote from peers d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015), 5c656c46b42546c890f3d9de55c54afe (127.24.205.131:38647)
I20260810 01:36:54.418805 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c8f3ff381fd423b87485276aa9a23e6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aaf709be804d6fa0cba0b167a0c134"
I20260810 01:36:54.418805 28876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c8f3ff381fd423b87485276aa9a23e6" candidate_uuid: "93b7785b10fe4533b7e505d3bf801d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c656c46b42546c890f3d9de55c54afe"
I20260810 01:36:54.418937 28876 raft_consensus.cc:3037] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:54.418937 28430 raft_consensus.cc:3037] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:54.420179 28430 raft_consensus.cc:2454] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 1.
I20260810 01:36:54.420181 28876 raft_consensus.cc:2454] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b7785b10fe4533b7e505d3bf801d10 in term 1.
I20260810 01:36:54.420499 28547 leader_election.cc:302] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c656c46b42546c890f3d9de55c54afe, 93b7785b10fe4533b7e505d3bf801d10; no voters:
I20260810 01:36:54.420660 29080 raft_consensus.cc:2781] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:54.420765 29080 raft_consensus.cc:686] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 LEADER]: Becoming Leader. State: Replica: 93b7785b10fe4533b7e505d3bf801d10, State: Running, Role: LEADER
I20260810 01:36:54.420913 29080 consensus_queue.cc:237] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } }
I20260810 01:36:54.422665 28181 catalog_manager.cc:5495] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b7785b10fe4533b7e505d3bf801d10 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "93b7785b10fe4533b7e505d3bf801d10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b7785b10fe4533b7e505d3bf801d10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 } health_report { overall_health: UNKNOWN } } }
I20260810 01:36:54.472743 29169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:54.469436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47302 (local address 127.24.205.130:46533)
0810 01:36:54.469785 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:54.469794 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:54.469805 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:36:54.469842 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:54.469844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:54.469882 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:54.469973 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:36:54.470252 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.470782 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.471630 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:54.471867 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:54.471981 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:54.472255 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:36:54.472325 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:36:54.472405 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:54.472525 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 01:36:54.472578 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":129,"threads_started":1}
I20260810 01:36:54.478578 28876 raft_consensus.cc:1261] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Refusing update from remote peer 93b7785b10fe4533b7e505d3bf801d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:54.478695 28430 raft_consensus.cc:1261] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134 [term 1 FOLLOWER]: Refusing update from remote peer 93b7785b10fe4533b7e505d3bf801d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:36:54.479049 29103 consensus_queue.cc:1035] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c656c46b42546c890f3d9de55c54afe" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:36:54.479252 29080 consensus_queue.cc:1035] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8aaf709be804d6fa0cba0b167a0c134" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:36:54.494367 29088 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 01:36:56.055368 28180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:56.055552 28180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:36:56.058677 28180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ef3fe389d514801908218199483d3e5: Sending DeleteTablet for 3 replicas of tablet 4c8f3ff381fd423b87485276aa9a23e6
I20260810 01:36:56.059302 28402 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c8f3ff381fd423b87485276aa9a23e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:56 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:49842
I20260810 01:36:56.059333 28622 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c8f3ff381fd423b87485276aa9a23e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:56 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:47276
I20260810 01:36:56.059391 28845 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c8f3ff381fd423b87485276aa9a23e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:36:56 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:53952
I20260810 01:36:56.059692 29205 tablet_replica.cc:330] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10: stopping tablet replica
I20260810 01:36:56.059727 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28289
I20260810 01:36:56.059764 29204 tablet_replica.cc:330] T 4c8f3ff381fd423b87485276aa9a23e6 P d8aaf709be804d6fa0cba0b167a0c134: stopping tablet replica
I20260810 01:36:56.067680 29205 raft_consensus.cc:2229] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:36:56.067998 29205 raft_consensus.cc:2258] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:56.068730 29205 ts_tablet_manager.cc:1905] T 4c8f3ff381fd423b87485276aa9a23e6 P 93b7785b10fe4533b7e505d3bf801d10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:36:56.070230 29207 tablet_replica.cc:330] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: stopping tablet replica
I20260810 01:36:56.070394 29207 raft_consensus.cc:2229] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:36:56.070564 29207 raft_consensus.cc:2258] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:36:56.071226 29207 ts_tablet_manager.cc:1905] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 01:36:56.076436 28160 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:44015 (error 108)
I20260810 01:36:56.076582 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28519
I20260810 01:36:56.088723 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:56.087465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.0.0.1:49872)
0810 01:36:56.088425 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:56.088561 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":840,"thread_start_us":546,"threads_started":1}
W20260810 01:36:56.089339 28160 catalog_manager.cc:4584] TS d8aaf709be804d6fa0cba0b167a0c134 (127.24.205.129:44015): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c8f3ff381fd423b87485276aa9a23e6: Network error: Client connection negotiation failed: client connection to 127.24.205.129:44015: connect: Connection refused (error 111)
I20260810 01:36:56.142792 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:56.142405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.0.0.1:49886)
0810 01:36:56.142612 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:56.142688 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 01:36:56.143838 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:56.143545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.0.0.1:49892)
0810 01:36:56.143683 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:56.143749 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 01:36:56.146333 29207 ts_tablet_manager.cc:1918] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:36:56.146443 29207 log.cc:1196] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/4c8f3ff381fd423b87485276aa9a23e6
I20260810 01:36:56.146792 29207 ts_tablet_manager.cc:1939] T 4c8f3ff381fd423b87485276aa9a23e6 P 5c656c46b42546c890f3d9de55c54afe: Deleting consensus metadata
I20260810 01:36:56.151019 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28746
I20260810 01:36:56.155954 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:56.151197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:46533 (local address 127.0.0.1:47314)
0810 01:36:56.155751 (+ 4554us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:56.155833 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.130:46533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4433}
I20260810 01:36:56.188575 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:56.188228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:46533 (local address 127.0.0.1:47326)
0810 01:36:56.188410 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:56.188480 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.130:46533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 01:36:56.189334 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:56.189125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:46533 (local address 127.0.0.1:47330)
0810 01:36:56.189228 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:56.189280 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.130:46533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 01:36:56.204645 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:56.204187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44015 (local address 127.0.0.1:49898)
0810 01:36:56.204397 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:56.204488 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 01:36:56.205075 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28122
2026-08-10T01:36:56Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6722 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:36:56 dist-test-slave-t3q3 krb5kdc[29213](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:36:56 dist-test-slave-t3q3 krb5kdc[29213](info): set up 2 sockets
Aug 10 01:36:56 dist-test-slave-t3q3 krb5kdc[29213](info): commencing operation
krb5kdc: starting...
W20260810 01:36:57.573113 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:36:57 dist-test-slave-t3q3 krb5kdc[29213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:36:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:36:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:36:57.704499 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:45901
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:45901
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:57.821595 29235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:57.821915 29235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:57.822026 29235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:57.826100 29235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:36:57.826185 29235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:57.826224 29235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:57.826279 29235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:36:57.826316 29235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:36:57.831668 29235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:45901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:45901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:57.832844 29235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:57.833969 29235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:57.843276 29244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:57.843281 29235 server_base.cc:1034] running on GCE node
W20260810 01:36:57.843298 29246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:57.843299 29243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:57.844174 29235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:57.845345 29235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:57.846520 29235 hybrid_clock.cc:648] HybridClock initialized: now 1786325817846501 us; error 37 us; skew 500 ppm
Aug 10 01:36:57 dist-test-slave-t3q3 krb5kdc[29213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325817, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:57.849632 29235 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:36:57.850660 29235 webserver.cc:460] Webserver started at http://127.24.205.190:37985/ using document root <none> and password file <none>
I20260810 01:36:57.851266 29235 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:57.851363 29235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:57.851612 29235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:57.853824 29235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "7e149d823c9a4f72bb9a58d0679c2da0"
format_stamp: "Formatted at 2026-08-10 01:36:57 on dist-test-slave-t3q3"
server_key: "409fc28c35430bf4281400faa0ce443a"
server_key_iv: "cb5c5467e0aaeba6563e05e253bfa78f"
server_key_version: "encryptionkey@0"
I20260810 01:36:57.854440 29235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "7e149d823c9a4f72bb9a58d0679c2da0"
format_stamp: "Formatted at 2026-08-10 01:36:57 on dist-test-slave-t3q3"
server_key: "409fc28c35430bf4281400faa0ce443a"
server_key_iv: "cb5c5467e0aaeba6563e05e253bfa78f"
server_key_version: "encryptionkey@0"
I20260810 01:36:57.858347 29235 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 01:36:57.860869 29258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:57.862354 29235 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:36:57.862507 29235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "7e149d823c9a4f72bb9a58d0679c2da0"
format_stamp: "Formatted at 2026-08-10 01:36:57 on dist-test-slave-t3q3"
server_key: "409fc28c35430bf4281400faa0ce443a"
server_key_iv: "cb5c5467e0aaeba6563e05e253bfa78f"
server_key_version: "encryptionkey@0"
I20260810 01:36:57.862627 29235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:57.881798 29235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:57.885313 29235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:57.885574 29235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:57.893623 29235 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:45901
I20260810 01:36:57.893653 29345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:45901 every 8 connection(s)
I20260810 01:36:57.894744 29235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:36:57.897805 29347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:36:57.901669 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 29235
I20260810 01:36:57.901764 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:36:57.902055 25398 external_mini_cluster.cc:1428] Setting key 6ab5e8a61f6921de023e2ad08ae46e10
I20260810 01:36:57.904356 29347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0: Bootstrap starting.
I20260810 01:36:57.907274 29347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0: Neither blocks nor log segments found. Creating new log.
I20260810 01:36:57.908278 29347 log.cc:824] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:36:57.910831 29347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0: No bootstrap required, opened a new log
Aug 10 01:36:57 dist-test-slave-t3q3 krb5kdc[29213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:57.915217 29347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45901 } }
I20260810 01:36:57.915536 29347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:36:57.915601 29347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e149d823c9a4f72bb9a58d0679c2da0, State: Initialized, Role: FOLLOWER
I20260810 01:36:57.916175 29347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45901 } }
I20260810 01:36:57.916389 29347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:36:57.916471 29347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:36:57.916574 29347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:36:57.917557 29347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45901 } }
I20260810 01:36:57.917969 29347 leader_election.cc:302] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e149d823c9a4f72bb9a58d0679c2da0; no voters:
I20260810 01:36:57.918380 29347 leader_election.cc:288] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:36:57.918481 29359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:36:57.918781 29359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [term 1 LEADER]: Becoming Leader. State: Replica: 7e149d823c9a4f72bb9a58d0679c2da0, State: Running, Role: LEADER
I20260810 01:36:57.919171 29359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45901 } }
I20260810 01:36:57.919658 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:57.903634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33650 (local address 127.24.205.190:45901)
0810 01:36:57.904156 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:57.904179 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:57.904225 (+ 46us) server_negotiation.cc:407] Connection header received
0810 01:36:57.905091 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:57.905116 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:57.905551 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:57.905984 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:57.906795 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:57.908411 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:57.909564 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:57.910261 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:57.910438 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:57.913266 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:57.913273 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:57.913291 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:57.913324 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:57.916126 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:57.916742 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:57.916749 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:57.916755 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:57.916899 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:57.917214 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:57.917218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:57.917219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:57.917665 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:57.917862 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:57.918259 (+ 397us) server_negotiation.cc:299] Negotiation successful
0810 01:36:57.918604 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":140,"threads_started":1}
I20260810 01:36:57.919948 29347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:36:57.921868 29363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e149d823c9a4f72bb9a58d0679c2da0. Latest consensus state: current_term: 1 leader_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45901 } } }
I20260810 01:36:57.922006 29363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [sys.catalog]: This master's current role is: LEADER
I20260810 01:36:57.922809 29367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e149d823c9a4f72bb9a58d0679c2da0" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45901 } } }
I20260810 01:36:57.922979 29367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0 [sys.catalog]: This master's current role is: LEADER
W20260810 01:36:57.925315 29380 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:36:57.925412 29380 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:36:57.925534 29382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:36:57.926482 29382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:36:57.932543 29382 catalog_manager.cc:1347] Generated new cluster ID: f401aaf97a414a4ab4d4790983f0171d
I20260810 01:36:57.932629 29382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:36:57.947363 29382 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:36:57.948779 29382 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:36:57.953958 29382 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e149d823c9a4f72bb9a58d0679c2da0: Generated new TSK 0
I20260810 01:36:57.954754 29382 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:36:57.991160 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:45901
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:58.120927 29391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:58.121173 29391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:58.121213 29391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:58.125023 29391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:58.125065 29391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:58.125118 29391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:36:58.130072 29391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:45901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:58.130954 29391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:58.131855 29391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:58.141213 29398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:58.141202 29403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:58.141250 29408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:58.141722 29391 server_base.cc:1034] running on GCE node
I20260810 01:36:58.142082 29391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:58.142627 29391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:58.143787 29391 hybrid_clock.cc:648] HybridClock initialized: now 1786325818143768 us; error 30 us; skew 500 ppm
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[29213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325818, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:58.146538 29391 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:36:58.147375 29391 webserver.cc:460] Webserver started at http://127.24.205.129:32951/ using document root <none> and password file <none>
I20260810 01:36:58.147936 29391 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:58.148029 29391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:58.148291 29391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:58.150287 29391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "c431619c1b17491f8e8679446fc51dd1"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "08b1a23be31c38d72a7282abb15fb0bf"
server_key_iv: "dcf43fe2333b127ec2a510595279f22e"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.150869 29391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "c431619c1b17491f8e8679446fc51dd1"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "08b1a23be31c38d72a7282abb15fb0bf"
server_key_iv: "dcf43fe2333b127ec2a510595279f22e"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.154567 29391 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:36:58.156982 29425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.158161 29391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:36:58.158311 29391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "c431619c1b17491f8e8679446fc51dd1"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "08b1a23be31c38d72a7282abb15fb0bf"
server_key_iv: "dcf43fe2333b127ec2a510595279f22e"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.158422 29391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:58.175956 29391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:58.178870 29391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:58.179076 29391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:58.179658 29391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:58.180562 29391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:58.180637 29391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.180718 29391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:58.180763 29391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.189960 29391 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:33301
I20260810 01:36:58.190048 29607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:33301 every 8 connection(s)
I20260810 01:36:58.190876 29391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[29213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325818, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:58.200176 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 29391
I20260810 01:36:58.200306 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:36:58.200603 25398 external_mini_cluster.cc:1428] Setting key 229b8811c93612fd0058a8819b759a95
I20260810 01:36:58.204563 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:58.192801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:40111 (local address 127.24.205.190:45901)
0810 01:36:58.192943 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:58.192947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:58.194114 (+ 1167us) server_negotiation.cc:407] Connection header received
0810 01:36:58.194996 (+ 882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:58.194999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:58.195046 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:58.195122 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:58.196328 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.196873 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.197979 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.198211 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.198291 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:58.200792 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:58.200796 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:58.200798 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:58.200825 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:58.202495 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:58.203009 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:58.203013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:58.203015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:58.203106 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:58.203462 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:58.203467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:58.203468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:58.203651 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:58.203759 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:58.204274 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 01:36:58.204395 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:36:58.205317 29611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:58.193190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:45901 (local address 127.24.205.129:40111)
0810 01:36:58.193939 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:58.193994 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:58.194795 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:58.195289 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:58.195295 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:58.195634 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:58.196185 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:58.196201 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.196983 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.196985 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:58.197856 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:58.197865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.198340 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.198343 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:58.198482 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:58.198993 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:58.199009 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:58.200623 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:58.202618 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:58.202624 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:58.202638 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:58.202900 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:58.203204 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:58.203208 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:58.203210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:58.203360 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:58.203757 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:58.203764 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:58.203994 (+ 230us) client_negotiation.cc:769] Sending connection context
0810 01:36:58.204229 (+ 235us) client_negotiation.cc:240] Negotiation successful
0810 01:36:58.204531 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":114,"threads_started":1}
I20260810 01:36:58.206561 29608 heartbeater.cc:347] Connected to a master server at 127.24.205.190:45901
I20260810 01:36:58.206820 29608 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:58.207446 29608 heartbeater.cc:511] Master 127.24.205.190:45901 requested a full tablet report, sending...
I20260810 01:36:58.209309 29291 ts_manager.cc:194] Registered new tserver with Master: c431619c1b17491f8e8679446fc51dd1 (127.24.205.129:33301)
I20260810 01:36:58.210944 29291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:40111
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:36:58.229393 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:45901
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:58.344532 29618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:58.344841 29618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:58.344887 29618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:58.349038 29618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:58.349099 29618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:58.349161 29618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:36:58.354417 29618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:45901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:58.355549 29618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:58.356710 29618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:58.366657 29628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:58.366631 29627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:58.366748 29634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:58.367069 29618 server_base.cc:1034] running on GCE node
I20260810 01:36:58.367579 29618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:58.368316 29618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:58.369501 29618 hybrid_clock.cc:648] HybridClock initialized: now 1786325818369470 us; error 52 us; skew 500 ppm
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[29213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325818, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:58.372363 29618 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:36:58.373322 29618 webserver.cc:460] Webserver started at http://127.24.205.130:35305/ using document root <none> and password file <none>
I20260810 01:36:58.374189 29618 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:58.374316 29618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:58.374569 29618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:58.377020 29618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "5385aac2ebab483ea230f1fc23606644"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "74baee052fa6f83e92e0a15b2bc744f9"
server_key_iv: "b7ff24ba40d1c955e1c23d2b7c504100"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.377636 29618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "5385aac2ebab483ea230f1fc23606644"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "74baee052fa6f83e92e0a15b2bc744f9"
server_key_iv: "b7ff24ba40d1c955e1c23d2b7c504100"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.381608 29618 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:36:58.384213 29642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.385618 29618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:36:58.385778 29618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "5385aac2ebab483ea230f1fc23606644"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "74baee052fa6f83e92e0a15b2bc744f9"
server_key_iv: "b7ff24ba40d1c955e1c23d2b7c504100"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.385902 29618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:58.398202 29618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:58.401618 29618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:58.401852 29618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:58.402496 29618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:58.403388 29618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:58.403463 29618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.403541 29618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:58.403586 29618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.413069 29618 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:42073
I20260810 01:36:58.413089 29815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:42073 every 8 connection(s)
I20260810 01:36:58.414034 29618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:36:58.416687 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 29618
I20260810 01:36:58.416783 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:36:58.417200 25398 external_mini_cluster.cc:1428] Setting key 5e90c42f058cd214b8ca8b7101ed6ed3
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[29213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325818, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:58.429458 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:58.416268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:47319 (local address 127.24.205.190:45901)
0810 01:36:58.416413 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:58.416417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:58.417706 (+ 1289us) server_negotiation.cc:407] Connection header received
0810 01:36:58.418741 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:58.418744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:58.418798 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:58.418875 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:58.420123 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.420735 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.422104 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.422409 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.422519 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:58.425792 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:58.425795 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:58.425797 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:58.425822 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:58.427259 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:58.427785 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:58.427789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:58.427790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:58.427882 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:58.428316 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:58.428320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:58.428321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:58.428514 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:58.428636 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:58.429145 (+ 509us) server_negotiation.cc:299] Negotiation successful
0810 01:36:58.429285 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:36:58.430292 29820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:58.416651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:45901 (local address 127.24.205.130:47319)
0810 01:36:58.417506 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:58.417566 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:58.418512 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:58.419052 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:58.419059 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:58.419420 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:58.419917 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:58.419930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.420859 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.420862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:58.421943 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:58.421975 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.422726 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.422730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:58.422943 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:58.423640 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:58.423660 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:58.425591 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:58.427382 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:58.427388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:58.427403 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:58.427675 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:58.427979 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:58.427984 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:58.427986 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:58.428209 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:58.428625 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:58.428631 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:58.428894 (+ 263us) client_negotiation.cc:769] Sending connection context
0810 01:36:58.429086 (+ 192us) client_negotiation.cc:240] Negotiation successful
0810 01:36:58.429428 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":162,"threads_started":1}
I20260810 01:36:58.431553 29816 heartbeater.cc:347] Connected to a master server at 127.24.205.190:45901
I20260810 01:36:58.431821 29816 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:58.432462 29816 heartbeater.cc:511] Master 127.24.205.190:45901 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:36:58.433718 29291 ts_manager.cc:194] Registered new tserver with Master: 5385aac2ebab483ea230f1fc23606644 (127.24.205.130:42073)
I20260810 01:36:58.434314 29291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:47319
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:36:58.449355 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:45901
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:36:58.562466 29825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:36:58.562714 29825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:36:58.562887 29825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:36:58.566974 29825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:36:58.567029 29825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:36:58.567086 29825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:36:58.572124 29825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:45901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:36:58.573076 29825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:36:58.574056 29825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:36:58.583483 29830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:58.583490 29833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:36:58.583490 29831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:36:58.583851 29825 server_base.cc:1034] running on GCE node
I20260810 01:36:58.584318 29825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:36:58.584905 29825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:36:58.586120 29825 hybrid_clock.cc:648] HybridClock initialized: now 1786325818586104 us; error 27 us; skew 500 ppm
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[29213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325818, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:36:58.589068 29825 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:36:58.589918 29825 webserver.cc:460] Webserver started at http://127.24.205.131:45759/ using document root <none> and password file <none>
I20260810 01:36:58.590533 29825 fs_manager.cc:359] Metadata directory not provided
I20260810 01:36:58.590631 29825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:36:58.590865 29825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:36:58.593012 29825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "dde0527f76314683a4755565ef4394a6"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "58c8946e0e7f7efcdbf898a9091b6bee"
server_key_iv: "67eefbd0994f84ffb16e3788fe901181"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.593611 29825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "dde0527f76314683a4755565ef4394a6"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "58c8946e0e7f7efcdbf898a9091b6bee"
server_key_iv: "67eefbd0994f84ffb16e3788fe901181"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.597393 29825 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:36:58.599819 29843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.601107 29825 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:36:58.601246 29825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "dde0527f76314683a4755565ef4394a6"
format_stamp: "Formatted at 2026-08-10 01:36:58 on dist-test-slave-t3q3"
server_key: "58c8946e0e7f7efcdbf898a9091b6bee"
server_key_iv: "67eefbd0994f84ffb16e3788fe901181"
server_key_version: "encryptionkey@0"
I20260810 01:36:58.601361 29825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:36:58.612618 29825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:36:58.615492 29825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:36:58.615701 29825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:36:58.616365 29825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:36:58.617208 29825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:36:58.617282 29825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.617357 29825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:36:58.617409 29825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:36:58.626646 29825 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:34755
I20260810 01:36:58.626669 30021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:34755 every 8 connection(s)
I20260810 01:36:58.627562 29825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:36:58.636453 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 29825
I20260810 01:36:58.636605 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:36:58.636945 25398 external_mini_cluster.cc:1428] Setting key 72e2be44245554d6f1d2b283233141c4
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[29213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325818, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:36:58.641695 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:58.629511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:33381 (local address 127.24.205.190:45901)
0810 01:36:58.629680 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:58.629683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:58.630747 (+ 1064us) server_negotiation.cc:407] Connection header received
0810 01:36:58.631622 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:58.631625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:58.631674 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:58.631752 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:58.633015 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.633572 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.634691 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.634903 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.634983 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:58.637886 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:36:58.637890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:36:58.637893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:36:58.637925 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:36:58.639641 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:58.640295 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:58.640298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:58.640300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:58.640385 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:36:58.640706 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:36:58.640708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:36:58.640709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:36:58.640912 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:36:58.640989 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:36:58.641461 (+ 472us) server_negotiation.cc:299] Negotiation successful
0810 01:36:58.641576 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 01:36:58.642514 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:36:58.629900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:45901 (local address 127.24.205.131:33381)
0810 01:36:58.630589 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0810 01:36:58.630630 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:36:58.631417 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:36:58.631930 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:36:58.631936 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:36:58.632363 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:36:58.632860 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:58.632874 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.633683 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.633685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:58.634578 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:36:58.634587 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:36:58.635068 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:36:58.635072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:36:58.635222 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:36:58.635779 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:36:58.635804 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:36:58.637724 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:36:58.639784 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:58.639793 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:58.639811 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:58.640194 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:58.640475 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:36:58.640477 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:36:58.640478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:36:58.640617 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:36:58.641002 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:36:58.641007 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:36:58.641242 (+ 235us) client_negotiation.cc:769] Sending connection context
0810 01:36:58.641397 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 01:36:58.641654 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":125,"threads_started":1}
I20260810 01:36:58.643769 30023 heartbeater.cc:347] Connected to a master server at 127.24.205.190:45901
I20260810 01:36:58.644019 30023 heartbeater.cc:464] Registering TS with master...
I20260810 01:36:58.644568 30023 heartbeater.cc:511] Master 127.24.205.190:45901 requested a full tablet report, sending...
I20260810 01:36:58.645601 29291 ts_manager.cc:194] Registered new tserver with Master: dde0527f76314683a4755565ef4394a6 (127.24.205.131:34755)
I20260810 01:36:58.646181 29291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:33381
I20260810 01:36:58.650904 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 01:36:58.667060 29355 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:36:58.665564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33664 (local address 127.24.205.190:45901)
0810 01:36:58.665721 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 01:36:58.665727 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:36:58.665887 (+ 160us) server_negotiation.cc:407] Connection header received
0810 01:36:58.666010 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:36:58.666012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:36:58.666056 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:36:58.666138 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:36:58.666878 (+ 740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33664: BlockingRecv error: recv got EOF from 127.0.0.1:33664 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 01:36:58.668118 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 29391
I20260810 01:36:58.698238 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 29618
I20260810 01:36:58.715283 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 29825
I20260810 01:36:58.725952 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 29235
2026-08-10T01:36:58Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2513 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[30043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[30043](info): set up 2 sockets
Aug 10 01:36:58 dist-test-slave-t3q3 krb5kdc[30043](info): commencing operation
krb5kdc: starting...
W20260810 01:36:59.990875 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:00 dist-test-slave-t3q3 krb5kdc[30043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:00.124653 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42795
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:42795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:00.242904 30060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:00.243193 30060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:00.243274 30060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:00.247251 30060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:00.247337 30060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:00.247378 30060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:00.247437 30060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:00.247478 30060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:00.252566 30060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:42795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:00.253554 30060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:00.254516 30060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:00.262902 30068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:00.262902 30067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:00.262953 30070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:00.263157 30060 server_base.cc:1034] running on GCE node
I20260810 01:37:00.263825 30060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:00.264921 30060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:00.266088 30060 hybrid_clock.cc:648] HybridClock initialized: now 1786325820266069 us; error 32 us; skew 500 ppm
Aug 10 01:37:00 dist-test-slave-t3q3 krb5kdc[30043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325820, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:00.269021 30060 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:00.269935 30060 webserver.cc:460] Webserver started at http://127.24.205.190:34075/ using document root <none> and password file <none>
I20260810 01:37:00.270530 30060 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:00.270624 30060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:00.270859 30060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:00.272913 30060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "ce65cf56e83142479d31f19e494d33fa"
format_stamp: "Formatted at 2026-08-10 01:37:00 on dist-test-slave-t3q3"
server_key: "d72d4069f057609c4299ab1a600dd6de"
server_key_iv: "f87c0bf83db1de0b2fc6d8d8bb9a4c4b"
server_key_version: "encryptionkey@0"
I20260810 01:37:00.273499 30060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "ce65cf56e83142479d31f19e494d33fa"
format_stamp: "Formatted at 2026-08-10 01:37:00 on dist-test-slave-t3q3"
server_key: "d72d4069f057609c4299ab1a600dd6de"
server_key_iv: "f87c0bf83db1de0b2fc6d8d8bb9a4c4b"
server_key_version: "encryptionkey@0"
I20260810 01:37:00.277194 30060 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260810 01:37:00.279471 30079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:00.280732 30060 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:00.280882 30060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "ce65cf56e83142479d31f19e494d33fa"
format_stamp: "Formatted at 2026-08-10 01:37:00 on dist-test-slave-t3q3"
server_key: "d72d4069f057609c4299ab1a600dd6de"
server_key_iv: "f87c0bf83db1de0b2fc6d8d8bb9a4c4b"
server_key_version: "encryptionkey@0"
I20260810 01:37:00.280989 30060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:00.304082 30060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:00.306939 30060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:00.307168 30060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:00.314764 30060 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:42795
I20260810 01:37:00.315133 30162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:42795 every 8 connection(s)
I20260810 01:37:00.315745 30060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:00.318547 30163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:00.321849 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 30060
I20260810 01:37:00.321971 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:00.322299 25398 external_mini_cluster.cc:1428] Setting key fd076a43da7d4ab668b381304a27fcf4
I20260810 01:37:00.324849 30163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa: Bootstrap starting.
I20260810 01:37:00.327052 30163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:00.327826 30163 log.cc:824] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:00.330156 30163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa: No bootstrap required, opened a new log
Aug 10 01:37:00 dist-test-slave-t3q3 krb5kdc[30043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:00.333967 30163 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce65cf56e83142479d31f19e494d33fa" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42795 } }
I20260810 01:37:00.334187 30163 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:00.334261 30163 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce65cf56e83142479d31f19e494d33fa, State: Initialized, Role: FOLLOWER
I20260810 01:37:00.334686 30163 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce65cf56e83142479d31f19e494d33fa" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42795 } }
I20260810 01:37:00.334869 30163 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:00.334949 30163 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:00.335059 30163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:00.336148 30163 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce65cf56e83142479d31f19e494d33fa" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42795 } }
I20260810 01:37:00.336516 30163 leader_election.cc:302] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce65cf56e83142479d31f19e494d33fa; no voters:
I20260810 01:37:00.336921 30163 leader_election.cc:288] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:00.337073 30170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:00.337344 30170 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [term 1 LEADER]: Becoming Leader. State: Replica: ce65cf56e83142479d31f19e494d33fa, State: Running, Role: LEADER
I20260810 01:37:00.337821 30170 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce65cf56e83142479d31f19e494d33fa" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42795 } }
I20260810 01:37:00.338150 30167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:00.323703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46274 (local address 127.24.205.190:42795)
0810 01:37:00.324210 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:00.324226 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:00.324262 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:37:00.324861 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:00.324877 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:00.325262 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:00.325590 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:00.326431 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:00.327485 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:00.328521 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:00.329183 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:00.329372 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:00.332232 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:00.332237 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:00.332250 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:00.332277 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:00.334696 (+ 2419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:00.335257 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:00.335263 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:00.335275 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:00.335389 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:00.335701 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:00.335703 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:00.335704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:00.336196 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:00.336402 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:00.336767 (+ 365us) server_negotiation.cc:299] Negotiation successful
0810 01:37:00.337118 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":139,"threads_started":1}
I20260810 01:37:00.338344 30163 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:00.339600 30174 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce65cf56e83142479d31f19e494d33fa. Latest consensus state: current_term: 1 leader_uuid: "ce65cf56e83142479d31f19e494d33fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce65cf56e83142479d31f19e494d33fa" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42795 } } }
I20260810 01:37:00.339730 30174 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:00.340013 30171 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce65cf56e83142479d31f19e494d33fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce65cf56e83142479d31f19e494d33fa" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42795 } } }
I20260810 01:37:00.340144 30183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:00.340147 30171 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:00.341298 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:37:00.343547 30183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:00.349310 30183 catalog_manager.cc:1347] Generated new cluster ID: f8c2a8d13aa14a30982b4b49e2bad5bd
I20260810 01:37:00.349397 30183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:00.365164 30183 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:00.366483 30183 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:00.367889 30167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:00.362051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46284 (local address 127.24.205.190:42795)
0810 01:37:00.362182 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:00.362187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:00.362494 (+ 307us) server_negotiation.cc:407] Connection header received
0810 01:37:00.362629 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:00.362632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:00.362691 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:00.362783 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:00.363446 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:00.364038 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:00.365254 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:00.365609 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:00.365740 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:00.366764 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:00.366768 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:00.366771 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:00.367379 (+ 608us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:00.367412 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:00.367432 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:00.367531 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:00.367652 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 01:37:00.367726 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":51}
I20260810 01:37:00.379379 30183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce65cf56e83142479d31f19e494d33fa: Generated new TSK 0
I20260810 01:37:00.380249 30183 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:37:00.387233 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 30060
2026-08-10T01:37:00Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1661 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:00 dist-test-slave-t3q3 krb5kdc[30212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:00 dist-test-slave-t3q3 krb5kdc[30212](info): set up 2 sockets
Aug 10 01:37:00 dist-test-slave-t3q3 krb5kdc[30212](info): commencing operation
krb5kdc: starting...
W20260810 01:37:01.667260 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:01 dist-test-slave-t3q3 krb5kdc[30212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:01.796955 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34691
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:34691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:01.913265 30233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:01.913527 30233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:01.913568 30233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:01.917501 30233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:01.917552 30233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:01.917572 30233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:01.917588 30233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:01.917604 30233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:01.922818 30233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:34691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:01.923753 30233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:01.924784 30233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:01.933408 30243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:01.933389 30241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:01.933576 30233 server_base.cc:1034] running on GCE node
W20260810 01:37:01.933414 30245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:01.934295 30233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:01.935446 30233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:01.936648 30233 hybrid_clock.cc:648] HybridClock initialized: now 1786325821936631 us; error 28 us; skew 500 ppm
Aug 10 01:37:01 dist-test-slave-t3q3 krb5kdc[30212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325821, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:01.943519 30233 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:01.944761 30233 webserver.cc:460] Webserver started at http://127.24.205.190:39189/ using document root <none> and password file <none>
I20260810 01:37:01.945381 30233 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:01.945447 30233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:01.945670 30233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:01.947728 30233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "530160b7f6124931969c3964046a0f65"
format_stamp: "Formatted at 2026-08-10 01:37:01 on dist-test-slave-t3q3"
server_key: "6ff5379677fce04396fde68db5aa91fd"
server_key_iv: "50f804df2cbb6e0ee23e2a6875d1e013"
server_key_version: "encryptionkey@0"
I20260810 01:37:01.948315 30233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "530160b7f6124931969c3964046a0f65"
format_stamp: "Formatted at 2026-08-10 01:37:01 on dist-test-slave-t3q3"
server_key: "6ff5379677fce04396fde68db5aa91fd"
server_key_iv: "50f804df2cbb6e0ee23e2a6875d1e013"
server_key_version: "encryptionkey@0"
I20260810 01:37:01.951946 30233 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:37:01.954401 30256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:01.955657 30233 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:01.955796 30233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "530160b7f6124931969c3964046a0f65"
format_stamp: "Formatted at 2026-08-10 01:37:01 on dist-test-slave-t3q3"
server_key: "6ff5379677fce04396fde68db5aa91fd"
server_key_iv: "50f804df2cbb6e0ee23e2a6875d1e013"
server_key_version: "encryptionkey@0"
I20260810 01:37:01.955907 30233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:01.972155 30233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:01.975206 30233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:01.975417 30233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:01.982468 30233 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:34691
I20260810 01:37:01.982785 30336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:34691 every 8 connection(s)
I20260810 01:37:01.983476 30233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:01.984035 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 30233
I20260810 01:37:01.984185 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:01.984536 25398 external_mini_cluster.cc:1428] Setting key 45df1dbc5dd6ca69bcd7cca79f80bbd7
I20260810 01:37:01.986696 30337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:01.993604 30337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65: Bootstrap starting.
Aug 10 01:37:01 dist-test-slave-t3q3 krb5kdc[30212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:01.995839 30337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:01.996639 30337 log.cc:824] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:01.998569 30337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65: No bootstrap required, opened a new log
I20260810 01:37:01.999501 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:01.986041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32850 (local address 127.24.205.190:34691)
0810 01:37:01.986478 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:01.986494 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:01.986532 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:37:01.987255 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:01.987275 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:01.987607 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:01.987904 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:01.988861 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:01.989865 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:01.991038 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:01.991498 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:01.991614 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:01.994554 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:01.994558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:01.994572 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:01.994599 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:01.996518 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:01.997041 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:01.997062 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:01.997067 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:01.997184 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:01.997488 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:01.997492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:01.997494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:01.997900 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:01.998123 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:01.998435 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 01:37:01.998782 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":149,"threads_started":1}
I20260810 01:37:02.001624 30337 raft_consensus.cc:348] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530160b7f6124931969c3964046a0f65" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34691 } }
I20260810 01:37:02.001835 30337 raft_consensus.cc:374] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:02.001905 30337 raft_consensus.cc:729] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530160b7f6124931969c3964046a0f65, State: Initialized, Role: FOLLOWER
I20260810 01:37:02.002411 30337 consensus_queue.cc:260] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530160b7f6124931969c3964046a0f65" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34691 } }
I20260810 01:37:02.002569 30337 raft_consensus.cc:388] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:02.002663 30337 raft_consensus.cc:482] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:02.002782 30337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:02.003690 30337 raft_consensus.cc:504] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530160b7f6124931969c3964046a0f65" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34691 } }
I20260810 01:37:02.004031 30337 leader_election.cc:302] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 530160b7f6124931969c3964046a0f65; no voters:
I20260810 01:37:02.004462 30337 leader_election.cc:288] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:02.004590 30345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:02.004842 30345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [term 1 LEADER]: Becoming Leader. State: Replica: 530160b7f6124931969c3964046a0f65, State: Running, Role: LEADER
I20260810 01:37:02.005138 30345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530160b7f6124931969c3964046a0f65" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34691 } }
I20260810 01:37:02.005757 30337 sys_catalog.cc:564] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:02.006904 30347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "530160b7f6124931969c3964046a0f65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530160b7f6124931969c3964046a0f65" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34691 } } }
I20260810 01:37:02.007023 30347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:02.007447 30360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:02.008188 30350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 530160b7f6124931969c3964046a0f65. Latest consensus state: current_term: 1 leader_uuid: "530160b7f6124931969c3964046a0f65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530160b7f6124931969c3964046a0f65" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34691 } } }
I20260810 01:37:02.008292 30350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:02.010761 30360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:02.016876 30360 catalog_manager.cc:1347] Generated new cluster ID: 3ee9cd6d9e0848bb8727ccac9d894bda
I20260810 01:37:02.016954 30360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:02.032662 30360 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:02.033663 30360 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:02.042781 30360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 530160b7f6124931969c3964046a0f65: Generated new TSK 0
I20260810 01:37:02.043489 30360 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:37:02.079281 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34691
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:02.207700 30378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:02.207965 30378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:02.208039 30378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:02.212045 30378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:02.212136 30378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:02.212232 30378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:02.217542 30378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:02.218631 30378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:02.219691 30378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:02.229583 30385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:02.229506 30384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:02.229512 30388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:02.229650 30378 server_base.cc:1034] running on GCE node
I20260810 01:37:02.230257 30378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:02.230934 30378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:02.232137 30378 hybrid_clock.cc:648] HybridClock initialized: now 1786325822232108 us; error 48 us; skew 500 ppm
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:02.235055 30378 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:37:02.235950 30378 webserver.cc:460] Webserver started at http://127.24.205.129:37019/ using document root <none> and password file <none>
I20260810 01:37:02.236613 30378 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:02.236711 30378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:02.236965 30378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:02.239135 30378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "be436ea127054cb18944b2bf8bd1a676"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "72c7fc27d6f45885154e82de95cd9aad"
server_key_iv: "748dea13f7a404d898885b5d5f69ac5f"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.239775 30378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "be436ea127054cb18944b2bf8bd1a676"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "72c7fc27d6f45885154e82de95cd9aad"
server_key_iv: "748dea13f7a404d898885b5d5f69ac5f"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.243759 30378 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:37:02.246433 30398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.247853 30378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 01:37:02.248001 30378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "be436ea127054cb18944b2bf8bd1a676"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "72c7fc27d6f45885154e82de95cd9aad"
server_key_iv: "748dea13f7a404d898885b5d5f69ac5f"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.248180 30378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:02.276032 30378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:02.279708 30378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:02.279943 30378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:02.280629 30378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:02.281512 30378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:02.281598 30378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.281678 30378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:02.281733 30378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.291074 30378 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:43653
I20260810 01:37:02.291122 30577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:43653 every 8 connection(s)
I20260810 01:37:02.292079 30378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:02.297456 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 30378
I20260810 01:37:02.297605 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:02.297942 25398 external_mini_cluster.cc:1428] Setting key 58edd60dfcde72af3f64a8f4bfe7b087
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:02.308295 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:02.294013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:60167 (local address 127.24.205.190:34691)
0810 01:37:02.294175 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:02.294179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:02.295126 (+ 947us) server_negotiation.cc:407] Connection header received
0810 01:37:02.296664 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:02.296667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:02.296726 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:02.296805 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:02.298496 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.299061 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.300749 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.300986 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.301076 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:02.304142 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:02.304149 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:02.304155 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:02.304191 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:02.305959 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.306615 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.306619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.306623 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.306711 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.307075 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.307079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.307081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.307279 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:02.307444 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:02.307940 (+ 496us) server_negotiation.cc:299] Negotiation successful
0810 01:37:02.308118 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:37:02.309185 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:02.294470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:34691 (local address 127.24.205.129:60167)
0810 01:37:02.294946 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:02.295005 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:02.296445 (+ 1440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:02.297016 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:02.297023 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:02.297580 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:02.298312 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:02.298336 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.299203 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.299206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:02.300617 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:02.300633 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.301162 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.301169 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:02.301412 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:02.302158 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:02.302175 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:02.303916 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:02.306095 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:02.306102 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:02.306120 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:02.306503 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:02.306808 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:02.306812 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:02.306814 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:02.306965 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:02.307395 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:02.307402 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:02.307691 (+ 289us) client_negotiation.cc:769] Sending connection context
0810 01:37:02.307899 (+ 208us) client_negotiation.cc:240] Negotiation successful
0810 01:37:02.308286 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:37:02.310678 30578 heartbeater.cc:347] Connected to a master server at 127.24.205.190:34691
I20260810 01:37:02.310987 30578 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:02.311645 30578 heartbeater.cc:511] Master 127.24.205.190:34691 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
I20260810 01:37:02.313488 30281 ts_manager.cc:194] Registered new tserver with Master: be436ea127054cb18944b2bf8bd1a676 (127.24.205.129:43653)
I20260810 01:37:02.315251 30281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:60167
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:37:02.331085 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34691
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:02.451651 30588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:02.451928 30588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:02.451972 30588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:02.456126 30588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:02.456202 30588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:02.456287 30588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:02.461863 30588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:02.462973 30588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:02.464042 30588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:37:02.474502 30588 server_base.cc:1034] running on GCE node
W20260810 01:37:02.474450 30595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:02.474453 30598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:02.474450 30596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:02.475193 30588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:02.475975 30588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:02.477144 30588 hybrid_clock.cc:648] HybridClock initialized: now 1786325822477124 us; error 29 us; skew 500 ppm
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:02.480022 30588 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:37:02.481024 30588 webserver.cc:460] Webserver started at http://127.24.205.130:32835/ using document root <none> and password file <none>
I20260810 01:37:02.481626 30588 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:02.481693 30588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:02.481935 30588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:02.484261 30588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "29dc30215a094c589ee58013d026f36d"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "5324b22279c6dcb4c7fee6a59b5f7766"
server_key_iv: "4de2256f27a48e23bbf494fbb6ff8cb5"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.484872 30588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "29dc30215a094c589ee58013d026f36d"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "5324b22279c6dcb4c7fee6a59b5f7766"
server_key_iv: "4de2256f27a48e23bbf494fbb6ff8cb5"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.488915 30588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:37:02.491477 30607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.492743 30588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:02.492887 30588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "29dc30215a094c589ee58013d026f36d"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "5324b22279c6dcb4c7fee6a59b5f7766"
server_key_iv: "4de2256f27a48e23bbf494fbb6ff8cb5"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.493010 30588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:02.519282 30588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:02.522635 30588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:02.522879 30588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:02.523541 30588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:02.524504 30588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:02.524585 30588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.524660 30588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:02.524721 30588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.533960 30588 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:43479
I20260810 01:37:02.533984 30782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:43479 every 8 connection(s)
I20260810 01:37:02.534922 30588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:02.539482 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 30588
I20260810 01:37:02.539626 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:02.539916 25398 external_mini_cluster.cc:1428] Setting key 790e980853ecf69eedd4cc8fb1755d4c
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:02.550581 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:02.536849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:50177 (local address 127.24.205.190:34691)
0810 01:37:02.536997 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:02.537000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:02.537858 (+ 858us) server_negotiation.cc:407] Connection header received
0810 01:37:02.539282 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:02.539286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:02.539347 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:02.539459 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:02.540999 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.541697 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.542903 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.543320 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.543448 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:02.546215 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:02.546221 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:02.546227 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:02.546262 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:02.548166 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.548754 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.548761 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.548766 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.548876 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.549254 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.549261 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.549264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.549554 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:02.549681 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:02.550225 (+ 544us) server_negotiation.cc:299] Negotiation successful
0810 01:37:02.550371 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:37:02.551383 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:02.537236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:34691 (local address 127.24.205.130:50177)
0810 01:37:02.537700 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:02.537748 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:02.539039 (+ 1291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:02.539679 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:02.539703 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:02.540182 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:02.540848 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:02.540867 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.541844 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.541846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:02.542764 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:02.542774 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.543475 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.543478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:02.543722 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:02.544476 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:02.544493 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:02.546028 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:02.548308 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:02.548313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:02.548325 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:02.548628 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:02.548987 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:02.548989 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:02.548990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:02.549147 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:02.549675 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:02.549680 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:02.549957 (+ 277us) client_negotiation.cc:769] Sending connection context
0810 01:37:02.550131 (+ 174us) client_negotiation.cc:240] Negotiation successful
0810 01:37:02.550407 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:37:02.552717 30784 heartbeater.cc:347] Connected to a master server at 127.24.205.190:34691
I20260810 01:37:02.552985 30784 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:02.553534 30784 heartbeater.cc:511] Master 127.24.205.190:34691 requested a full tablet report, sending...
I20260810 01:37:02.554646 30281 ts_manager.cc:194] Registered new tserver with Master: 29dc30215a094c589ee58013d026f36d (127.24.205.130:43479)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:37:02.555365 30281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:50177
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:37:02.571380 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34691
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:02.702517 30790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:02.702782 30790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:02.702826 30790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:02.706976 30790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:02.707042 30790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:02.707103 30790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:02.712634 30790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:02.713763 30790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:02.714850 30790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:02.724893 30797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:02.724900 30803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:02.724920 30799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:02.725274 30790 server_base.cc:1034] running on GCE node
I20260810 01:37:02.725705 30790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:02.726397 30790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:02.727593 30790 hybrid_clock.cc:648] HybridClock initialized: now 1786325822727576 us; error 32 us; skew 500 ppm
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:02.731704 30790 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:37:02.733196 30790 webserver.cc:460] Webserver started at http://127.24.205.131:39273/ using document root <none> and password file <none>
I20260810 01:37:02.734021 30790 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:02.734118 30790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:02.734372 30790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:02.737499 30790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "89da189d464a460daf94243601b2c53b"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "9db4ac04ff7a4831348f50732b943a9a"
server_key_iv: "1494d3ed5d96edf0415d46d500d1652a"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.738312 30790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "89da189d464a460daf94243601b2c53b"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "9db4ac04ff7a4831348f50732b943a9a"
server_key_iv: "1494d3ed5d96edf0415d46d500d1652a"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.742537 30790 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:02.745091 30813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.746546 30790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:37:02.746690 30790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "89da189d464a460daf94243601b2c53b"
format_stamp: "Formatted at 2026-08-10 01:37:02 on dist-test-slave-t3q3"
server_key: "9db4ac04ff7a4831348f50732b943a9a"
server_key_iv: "1494d3ed5d96edf0415d46d500d1652a"
server_key_version: "encryptionkey@0"
I20260810 01:37:02.746809 30790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:02.760574 30790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:02.763569 30790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:02.763777 30790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:02.764474 30790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:02.765328 30790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:02.765403 30790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.765475 30790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:02.765527 30790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:02.775380 30790 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:34773
I20260810 01:37:02.775400 30978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:34773 every 8 connection(s)
I20260810 01:37:02.776576 30790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:02.779871 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 30790
I20260810 01:37:02.780014 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:02.780345 25398 external_mini_cluster.cc:1428] Setting key b79e862ed550621b1ea57a5901be10b0
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:02.790616 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:02.778469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:45213 (local address 127.24.205.190:34691)
0810 01:37:02.778608 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:02.778612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:02.779480 (+ 868us) server_negotiation.cc:407] Connection header received
0810 01:37:02.781147 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:02.781150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:02.781208 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:02.781291 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:02.782476 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.783008 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.784204 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.784427 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.784540 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:02.787105 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:02.787109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:02.787111 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:02.787135 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:02.788517 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.789064 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.789068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.789070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.789157 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.789523 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.789527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.789529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.789716 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:02.789830 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:02.790325 (+ 495us) server_negotiation.cc:299] Negotiation successful
0810 01:37:02.790450 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:37:02.791441 30982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:02.778875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:34691 (local address 127.24.205.131:45213)
0810 01:37:02.779330 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:02.779374 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:02.780919 (+ 1545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:02.781466 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:02.781474 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:02.781847 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:02.782334 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:02.782348 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.783149 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.783152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:02.784036 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:02.784045 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.784587 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.784592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:02.784762 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:02.785378 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:02.785394 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:02.786930 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:02.788647 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:02.788653 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:02.788669 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:02.788947 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:02.789263 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:02.789267 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:02.789269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:02.789413 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:02.789827 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:02.789833 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:02.790082 (+ 249us) client_negotiation.cc:769] Sending connection context
0810 01:37:02.790281 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 01:37:02.790609 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":116,"threads_started":1}
I20260810 01:37:02.792605 30979 heartbeater.cc:347] Connected to a master server at 127.24.205.190:34691
I20260810 01:37:02.792881 30979 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:02.793504 30979 heartbeater.cc:511] Master 127.24.205.190:34691 requested a full tablet report, sending...
I20260810 01:37:02.794559 30281 ts_manager.cc:194] Registered new tserver with Master: 89da189d464a460daf94243601b2c53b (127.24.205.131:34773)
I20260810 01:37:02.795118 30281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:45213
I20260810 01:37:02.805981 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325822, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:02.833304 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:02.824918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32858 (local address 127.24.205.190:34691)
0810 01:37:02.825105 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:02.825109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:02.825212 (+ 103us) server_negotiation.cc:407] Connection header received
0810 01:37:02.825332 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:02.825335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:02.825382 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:02.825456 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:02.826222 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.826737 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.827571 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:02.827780 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:02.827856 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:02.830277 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:02.830280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:02.830282 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:02.830306 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:02.831730 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.832136 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.832138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.832140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.832225 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:02.832460 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:02.832462 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:02.832463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:02.832676 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:02.832780 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:02.832986 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 01:37:02.833082 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260810 01:37:02.833781 30281 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:32858
I20260810 01:37:02.834815 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 30378
I20260810 01:37:02.857227 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 30588
I20260810 01:37:02.876127 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 30790
I20260810 01:37:02.894176 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 30233
2026-08-10T01:37:02Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2505 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30995](info): set up 2 sockets
Aug 10 01:37:02 dist-test-slave-t3q3 krb5kdc[30995](info): commencing operation
krb5kdc: starting...
W20260810 01:37:04.170944 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:04 dist-test-slave-t3q3 krb5kdc[30995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:04.301419 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38111
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:38111
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:04.418028 31016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:04.418301 31016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:04.418342 31016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:04.422263 31016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:04.422319 31016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:04.422338 31016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:04.422354 31016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:04.422370 31016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:04.427872 31016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:38111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:04.429018 31016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:04.430011 31016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:04.438880 31028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:04.438880 31026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:04.438874 31025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:04.439275 31016 server_base.cc:1034] running on GCE node
I20260810 01:37:04.439936 31016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:04.441157 31016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:04.442329 31016 hybrid_clock.cc:648] HybridClock initialized: now 1786325824442314 us; error 32 us; skew 500 ppm
Aug 10 01:37:04 dist-test-slave-t3q3 krb5kdc[30995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325824, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:04.445456 31016 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:04.446427 31016 webserver.cc:460] Webserver started at http://127.24.205.190:42699/ using document root <none> and password file <none>
I20260810 01:37:04.446988 31016 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:04.447050 31016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:04.447227 31016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:04.449509 31016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "25a688832139438195046c36e0028bc7"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "fca9a1b1174ab3563e37449696b50991"
server_key_iv: "253bbdb96cc4461063c95a2beb8d03af"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.450054 31016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "25a688832139438195046c36e0028bc7"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "fca9a1b1174ab3563e37449696b50991"
server_key_iv: "253bbdb96cc4461063c95a2beb8d03af"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.453940 31016 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:04.456416 31040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:04.457796 31016 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:37:04.457952 31016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "25a688832139438195046c36e0028bc7"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "fca9a1b1174ab3563e37449696b50991"
server_key_iv: "253bbdb96cc4461063c95a2beb8d03af"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.458087 31016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:04.473795 31016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:04.477103 31016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:04.477332 31016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:04.485141 31016 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:38111
I20260810 01:37:04.485162 31119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:38111 every 8 connection(s)
I20260810 01:37:04.486223 31016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:04.488714 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 31016
I20260810 01:37:04.488863 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:04.489199 25398 external_mini_cluster.cc:1428] Setting key d6838b9b3d60997c141d6ebcbc9f23bb
I20260810 01:37:04.489632 31120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:04.497357 31120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7: Bootstrap starting.
Aug 10 01:37:04 dist-test-slave-t3q3 krb5kdc[30995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:04.500110 31120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:04.501021 31120 log.cc:824] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:04.503041 31120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7: No bootstrap required, opened a new log
I20260810 01:37:04.504357 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:04.490720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.24.205.190:38111)
0810 01:37:04.491171 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:04.491189 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:04.491229 (+ 40us) server_negotiation.cc:407] Connection header received
0810 01:37:04.491911 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:04.491929 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:04.492295 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:04.492583 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:04.493645 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:04.494684 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:04.495893 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:04.496422 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:04.496544 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:04.499421 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:04.499426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:04.499439 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:04.499469 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:04.501366 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:04.501847 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:04.501852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:04.501856 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:04.501974 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:04.502289 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:04.502293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:04.502295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:04.502702 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:04.502928 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:04.503239 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 01:37:04.503548 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":162,"threads_started":1}
I20260810 01:37:04.507385 31120 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25a688832139438195046c36e0028bc7" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38111 } }
I20260810 01:37:04.507648 31120 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:04.507745 31120 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a688832139438195046c36e0028bc7, State: Initialized, Role: FOLLOWER
I20260810 01:37:04.508244 31120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25a688832139438195046c36e0028bc7" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38111 } }
I20260810 01:37:04.508412 31120 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:04.508491 31120 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:04.508623 31120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:04.509642 31120 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25a688832139438195046c36e0028bc7" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38111 } }
I20260810 01:37:04.510049 31120 leader_election.cc:302] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25a688832139438195046c36e0028bc7; no voters:
I20260810 01:37:04.510447 31120 leader_election.cc:288] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:04.510545 31127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:04.510749 31127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [term 1 LEADER]: Becoming Leader. State: Replica: 25a688832139438195046c36e0028bc7, State: Running, Role: LEADER
I20260810 01:37:04.511055 31127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25a688832139438195046c36e0028bc7" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38111 } }
I20260810 01:37:04.511807 31120 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:04.512830 31130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25a688832139438195046c36e0028bc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25a688832139438195046c36e0028bc7" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38111 } } }
I20260810 01:37:04.513010 31130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:04.513163 31129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25a688832139438195046c36e0028bc7. Latest consensus state: current_term: 1 leader_uuid: "25a688832139438195046c36e0028bc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25a688832139438195046c36e0028bc7" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38111 } } }
I20260810 01:37:04.513393 31129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:04.513676 31140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:04.517271 31140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:04.523305 31140 catalog_manager.cc:1347] Generated new cluster ID: dac17ac423674a168549724ccf5e73df
I20260810 01:37:04.523384 31140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:04.545128 31140 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:04.546545 31140 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:04.557301 31140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25a688832139438195046c36e0028bc7: Generated new TSK 0
I20260810 01:37:04.558275 31140 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:37:04.595907 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38111
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:04.713174 31162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:04.713500 31162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:04.713580 31162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:04.717671 31162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:04.717726 31162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:04.717820 31162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:04.722996 31162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:04.724043 31162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:04.725152 31162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:04.737087 31171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:04.737071 31169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:04.737071 31168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:04.737277 31162 server_base.cc:1034] running on GCE node
I20260810 01:37:04.737936 31162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:04.738606 31162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:04.739784 31162 hybrid_clock.cc:648] HybridClock initialized: now 1786325824739765 us; error 32 us; skew 500 ppm
Aug 10 01:37:04 dist-test-slave-t3q3 krb5kdc[30995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325824, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:04.742786 31162 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:37:04.743819 31162 webserver.cc:460] Webserver started at http://127.24.205.129:37113/ using document root <none> and password file <none>
I20260810 01:37:04.744477 31162 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:04.744572 31162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:04.744807 31162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:04.746976 31162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "964ebd45d1084577866c4249558c2fe7"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "54a4d58c1dd97bbda840454dde6a1cdd"
server_key_iv: "01af4604bd46abf244a0410a4a46b845"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.747591 31162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "964ebd45d1084577866c4249558c2fe7"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "54a4d58c1dd97bbda840454dde6a1cdd"
server_key_iv: "01af4604bd46abf244a0410a4a46b845"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.751573 31162 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:37:04.754228 31178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:04.755511 31162 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:04.755667 31162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "964ebd45d1084577866c4249558c2fe7"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "54a4d58c1dd97bbda840454dde6a1cdd"
server_key_iv: "01af4604bd46abf244a0410a4a46b845"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.755792 31162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:04.778563 31162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:04.783239 31162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:04.783488 31162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:04.784276 31162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:04.785202 31162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:04.785250 31162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:04.785323 31162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:04.785354 31162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:04.794765 31162 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:46179
I20260810 01:37:04.794785 31368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:46179 every 8 connection(s)
I20260810 01:37:04.795729 31162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:04.804229 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 31162
I20260810 01:37:04.804379 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:04.804770 25398 external_mini_cluster.cc:1428] Setting key 7e8effa637f35197826a6f67f44036f7
Aug 10 01:37:04 dist-test-slave-t3q3 krb5kdc[30995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325824, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:04.810972 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:04.797648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:52881 (local address 127.24.205.190:38111)
0810 01:37:04.797787 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:04.797792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:04.798645 (+ 853us) server_negotiation.cc:407] Connection header received
0810 01:37:04.800117 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:04.800120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:04.800180 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:04.800306 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:04.801539 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:04.802093 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:04.803289 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:04.803538 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:04.803652 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:04.806773 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:04.806777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:04.806781 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:04.806813 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:04.808535 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:04.809230 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:04.809233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:04.809234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:04.809315 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:04.809724 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:04.809726 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:04.809727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:04.809905 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:04.809982 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:04.810659 (+ 677us) server_negotiation.cc:299] Negotiation successful
0810 01:37:04.810796 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:37:04.811918 31373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:04.798030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38111 (local address 127.24.205.129:52881)
0810 01:37:04.798493 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:04.798539 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:04.799878 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:04.800491 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:04.800499 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:04.800882 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:04.801377 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:04.801392 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:04.802232 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:04.802235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:04.803151 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:04.803160 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:04.803699 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:04.803703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:04.803910 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:04.804676 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:04.804701 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:04.806590 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:04.808686 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:04.808694 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:04.808713 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:04.809103 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:04.809413 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:04.809419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:04.809421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:04.809616 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:04.810016 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:04.810024 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:04.810368 (+ 344us) client_negotiation.cc:769] Sending connection context
0810 01:37:04.810603 (+ 235us) client_negotiation.cc:240] Negotiation successful
0810 01:37:04.810940 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":112,"threads_started":1}
I20260810 01:37:04.813305 31370 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38111
I20260810 01:37:04.813601 31370 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:04.814286 31370 heartbeater.cc:511] Master 127.24.205.190:38111 requested a full tablet report, sending...
I20260810 01:37:04.815949 31065 ts_manager.cc:194] Registered new tserver with Master: 964ebd45d1084577866c4249558c2fe7 (127.24.205.129:46179)
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:37:04.817210 31065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:52881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:37:04.835629 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38111
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:04.955703 31377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:04.956053 31377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:04.956198 31377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:04.960408 31377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:04.960489 31377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:04.960573 31377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:04.966050 31377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:04.967244 31377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:04.968382 31377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:04.978241 31387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:04.978327 31394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:04.978253 31390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:04.978826 31377 server_base.cc:1034] running on GCE node
I20260810 01:37:04.979245 31377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:04.979872 31377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:04.981058 31377 hybrid_clock.cc:648] HybridClock initialized: now 1786325824981037 us; error 34 us; skew 500 ppm
Aug 10 01:37:04 dist-test-slave-t3q3 krb5kdc[30995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325824, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:04.983945 31377 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:37:04.984935 31377 webserver.cc:460] Webserver started at http://127.24.205.130:32889/ using document root <none> and password file <none>
I20260810 01:37:04.985519 31377 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:04.985615 31377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:04.985838 31377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:04.987897 31377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "b7c51889915f4646bb0cd56d68a42954"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "d1636dcbdd2ad9fdc050f38528835a1a"
server_key_iv: "8da967d9213479957bf785fed804490e"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.988538 31377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "b7c51889915f4646bb0cd56d68a42954"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "d1636dcbdd2ad9fdc050f38528835a1a"
server_key_iv: "8da967d9213479957bf785fed804490e"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.992293 31377 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:04.994803 31403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:04.996165 31377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:04.996307 31377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "b7c51889915f4646bb0cd56d68a42954"
format_stamp: "Formatted at 2026-08-10 01:37:04 on dist-test-slave-t3q3"
server_key: "d1636dcbdd2ad9fdc050f38528835a1a"
server_key_iv: "8da967d9213479957bf785fed804490e"
server_key_version: "encryptionkey@0"
I20260810 01:37:04.996424 31377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:05.008889 31377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:05.012030 31377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:05.012326 31377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:05.013025 31377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:05.013906 31377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:05.013957 31377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:05.014026 31377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:05.014058 31377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:05.023233 31377 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:35957
I20260810 01:37:05.023252 31579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:35957 every 8 connection(s)
I20260810 01:37:05.024277 31377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:05.033622 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 31377
I20260810 01:37:05.033782 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[30995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325824, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:05.034113 25398 external_mini_cluster.cc:1428] Setting key fb4947e1f700f3d7ea7ad9af02a97030
I20260810 01:37:05.038914 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:05.026147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:53271 (local address 127.24.205.190:38111)
0810 01:37:05.026298 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:05.026301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:05.027100 (+ 799us) server_negotiation.cc:407] Connection header received
0810 01:37:05.028592 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:05.028606 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:05.028658 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:05.028737 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:05.029920 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.030468 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.031606 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.031819 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.031898 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:05.034587 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:05.034590 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:05.034592 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:05.034661 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:05.036586 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.037097 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.037104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.037108 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.037221 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.037562 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.037568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.037573 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.037844 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:05.037963 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:05.038655 (+ 692us) server_negotiation.cc:299] Negotiation successful
0810 01:37:05.038770 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:37:05.040048 31584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:05.026477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38111 (local address 127.24.205.130:53271)
0810 01:37:05.026933 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:05.026978 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:05.028365 (+ 1387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:05.028913 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:05.028919 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:05.029278 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:05.029786 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:05.029800 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.030579 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.030581 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:05.031488 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:05.031498 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.031952 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.031955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:05.032155 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:05.032728 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:05.032745 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:05.034378 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:05.036707 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:05.036712 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:05.036725 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:05.036989 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:05.037318 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:05.037320 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:05.037322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:05.037468 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:05.037976 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:05.037985 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:05.038354 (+ 369us) client_negotiation.cc:769] Sending connection context
0810 01:37:05.038613 (+ 259us) client_negotiation.cc:240] Negotiation successful
0810 01:37:05.039016 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260810 01:37:05.041518 31580 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38111
I20260810 01:37:05.041792 31580 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:05.042307 31580 heartbeater.cc:511] Master 127.24.205.190:38111 requested a full tablet report, sending...
I20260810 01:37:05.043423 31065 ts_manager.cc:194] Registered new tserver with Master: b7c51889915f4646bb0cd56d68a42954 (127.24.205.130:35957)
I20260810 01:37:05.044019 31065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:53271
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:37:05.065354 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38111
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:05.184209 31588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:05.184512 31588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:05.184597 31588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:05.188741 31588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:05.188839 31588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:05.188930 31588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:05.194314 31588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:05.195449 31588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:05.196527 31588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:05.206563 31596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:05.206559 31598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:05.206653 31595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:05.206889 31588 server_base.cc:1034] running on GCE node
I20260810 01:37:05.207430 31588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:05.208103 31588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:05.209312 31588 hybrid_clock.cc:648] HybridClock initialized: now 1786325825209293 us; error 29 us; skew 500 ppm
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[30995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325825, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:05.212455 31588 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:37:05.213428 31588 webserver.cc:460] Webserver started at http://127.24.205.131:37153/ using document root <none> and password file <none>
I20260810 01:37:05.214040 31588 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:05.214141 31588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:05.214387 31588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:05.216615 31588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "57bd48a2493345f2b67563eb161ce270"
format_stamp: "Formatted at 2026-08-10 01:37:05 on dist-test-slave-t3q3"
server_key: "69dbfd634e285f43a4d121611b7e91f6"
server_key_iv: "217421cee6f939b93258a94290d85776"
server_key_version: "encryptionkey@0"
I20260810 01:37:05.217228 31588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "57bd48a2493345f2b67563eb161ce270"
format_stamp: "Formatted at 2026-08-10 01:37:05 on dist-test-slave-t3q3"
server_key: "69dbfd634e285f43a4d121611b7e91f6"
server_key_iv: "217421cee6f939b93258a94290d85776"
server_key_version: "encryptionkey@0"
I20260810 01:37:05.221112 31588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:37:05.223630 31609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:05.224979 31588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:05.225149 31588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "57bd48a2493345f2b67563eb161ce270"
format_stamp: "Formatted at 2026-08-10 01:37:05 on dist-test-slave-t3q3"
server_key: "69dbfd634e285f43a4d121611b7e91f6"
server_key_iv: "217421cee6f939b93258a94290d85776"
server_key_version: "encryptionkey@0"
I20260810 01:37:05.225270 31588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:05.246114 31588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:05.249763 31588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:05.250000 31588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:05.250651 31588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:05.251562 31588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:05.251636 31588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:05.251711 31588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:05.251765 31588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:05.261288 31588 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:40103
I20260810 01:37:05.261358 31780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:40103 every 8 connection(s)
I20260810 01:37:05.262372 31588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:05.263521 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 31588
I20260810 01:37:05.263651 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:05.264025 25398 external_mini_cluster.cc:1428] Setting key 43f1d749640275698efb0b4b3154bbdc
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[30995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325825, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:05.277182 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:05.266134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:40451 (local address 127.24.205.190:38111)
0810 01:37:05.266273 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:05.266279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:05.266294 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:05.267470 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:05.267473 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:05.267523 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:05.267595 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:05.268861 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.269411 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.270569 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.270798 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.270892 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:05.273386 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:05.273390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:05.273392 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:05.273417 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:05.274948 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.275450 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.275453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.275454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.275540 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.275933 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.275936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.275937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.276224 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:05.276316 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:05.276910 (+ 594us) server_negotiation.cc:299] Negotiation successful
0810 01:37:05.277045 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 01:37:05.278290 31784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:05.265150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38111 (local address 127.24.205.131:40451)
0810 01:37:05.265692 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:05.265762 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:05.267254 (+ 1492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:05.267800 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:05.267808 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:05.268201 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:05.268700 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:05.268724 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.269524 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.269526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:05.270425 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:05.270434 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.270940 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.270943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:05.271083 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:05.271646 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:05.271662 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:05.273222 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:05.275075 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:05.275080 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:05.275092 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:05.275356 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:05.275624 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:05.275626 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:05.275628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:05.275775 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:05.276323 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:05.276327 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:05.276592 (+ 265us) client_negotiation.cc:769] Sending connection context
0810 01:37:05.276828 (+ 236us) client_negotiation.cc:240] Negotiation successful
0810 01:37:05.277182 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":146,"threads_started":1}
I20260810 01:37:05.279484 31781 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38111
I20260810 01:37:05.279775 31781 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:05.280350 31781 heartbeater.cc:511] Master 127.24.205.190:38111 requested a full tablet report, sending...
I20260810 01:37:05.281445 31065 ts_manager.cc:194] Registered new tserver with Master: 57bd48a2493345f2b67563eb161ce270 (127.24.205.131:40103)
I20260810 01:37:05.282013 31065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:40451
I20260810 01:37:05.290094 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[30995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[30995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:37:05.317835 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:05.308243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53276 (local address 127.24.205.129:46179)
0810 01:37:05.308526 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:05.308540 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:05.308564 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:37:05.308616 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:05.308621 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:05.308808 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:05.308933 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:05.309608 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.310443 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.311313 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.311816 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.311910 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:05.314544 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:05.314553 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:05.314567 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:05.314592 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:05.316173 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.316565 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.316570 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.316571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.316653 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.316904 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.316906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.316907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.317140 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:05.317312 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:05.317469 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 01:37:05.317625 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":85,"threads_started":1}
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[30995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:05.328847 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:05.320763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46376 (local address 127.24.205.190:38111)
0810 01:37:05.320919 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:05.320923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:05.320938 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:05.321053 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:05.321055 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:05.321098 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:05.321166 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:05.321735 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.322249 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.322979 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:05.323184 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:05.323271 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:05.325680 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:05.325683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:05.325685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:05.325712 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:05.327197 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.327581 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.327584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.327585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.327663 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:05.327894 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:05.327896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:05.327897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:05.328191 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:05.328316 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:05.328519 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 01:37:05.328641 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 01:37:05.329301 31065 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46376
I20260810 01:37:05.330106 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 31162
I20260810 01:37:05.358999 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 31377
I20260810 01:37:05.375174 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 31588
I20260810 01:37:05.388520 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 31016
2026-08-10T01:37:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2492 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[31802](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[31802](info): set up 2 sockets
Aug 10 01:37:05 dist-test-slave-t3q3 krb5kdc[31802](info): commencing operation
krb5kdc: starting...
W20260810 01:37:06.657405 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:06 dist-test-slave-t3q3 krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:06.789515 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42101
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:42101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:06.904076 31821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:06.904336 31821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:06.904381 31821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:06.908288 31821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:06.908334 31821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:06.908355 31821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:06.908371 31821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:06.908386 31821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:06.913406 31821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:42101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:06.914353 31821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:06.915293 31821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:06.923619 31835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:06.923607 31838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:06.923848 31821 server_base.cc:1034] running on GCE node
W20260810 01:37:06.923928 31834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:06.924566 31821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:06.925621 31821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:06.926795 31821 hybrid_clock.cc:648] HybridClock initialized: now 1786325826926769 us; error 39 us; skew 500 ppm
Aug 10 01:37:06 dist-test-slave-t3q3 krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325826, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:06.929672 31821 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:06.930444 31821 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:06.930507 31821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:06.930728 31821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:06.932859 31821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "225fad4d487749949466e68cea3b3838"
format_stamp: "Formatted at 2026-08-10 01:37:06 on dist-test-slave-t3q3"
server_key: "066c13fb3b65191059d7e7c1386cb4df"
server_key_iv: "c715f5d993becc1c9469e8aa94dc3ccb"
server_key_version: "encryptionkey@0"
I20260810 01:37:06.933492 31821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "225fad4d487749949466e68cea3b3838"
format_stamp: "Formatted at 2026-08-10 01:37:06 on dist-test-slave-t3q3"
server_key: "066c13fb3b65191059d7e7c1386cb4df"
server_key_iv: "c715f5d993becc1c9469e8aa94dc3ccb"
server_key_version: "encryptionkey@0"
I20260810 01:37:06.937288 31821 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 01:37:06.939744 31844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:06.941054 31821 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:06.941223 31821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "225fad4d487749949466e68cea3b3838"
format_stamp: "Formatted at 2026-08-10 01:37:06 on dist-test-slave-t3q3"
server_key: "066c13fb3b65191059d7e7c1386cb4df"
server_key_iv: "c715f5d993becc1c9469e8aa94dc3ccb"
server_key_version: "encryptionkey@0"
I20260810 01:37:06.941339 31821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:06.960625 31821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:06.963476 31821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:06.963688 31821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:06.971204 31821 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:42101
I20260810 01:37:06.971467 31926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:42101 every 8 connection(s)
I20260810 01:37:06.971918 31821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:06.974874 31927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:06.976950 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 31821
I20260810 01:37:06.977101 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:06.977409 25398 external_mini_cluster.cc:1428] Setting key 2c4639d1114f333a73fdcdeb12469ef5
I20260810 01:37:06.981983 31927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838: Bootstrap starting.
I20260810 01:37:06.984754 31927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:06.985739 31927 log.cc:824] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:37:06 dist-test-slave-t3q3 krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:06.987928 31927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838: No bootstrap required, opened a new log
I20260810 01:37:06.991602 31927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225fad4d487749949466e68cea3b3838" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42101 } }
I20260810 01:37:06.991832 31927 raft_consensus.cc:374] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:06.991899 31927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225fad4d487749949466e68cea3b3838, State: Initialized, Role: FOLLOWER
I20260810 01:37:06.992379 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:06.978838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.24.205.190:42101)
0810 01:37:06.979267 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:06.979284 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:06.979320 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:37:06.979982 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:06.980003 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:06.980414 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:06.980701 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:06.981661 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:06.982704 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:06.983947 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:06.984514 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:06.984644 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:06.987568 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:06.987574 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:06.987588 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:06.987616 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:06.989322 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:06.989799 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:06.989804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:06.989809 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:06.989925 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:06.990235 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:06.990239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:06.990241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:06.990642 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:06.990873 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:06.991213 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 01:37:06.991496 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":143,"threads_started":1}
I20260810 01:37:06.992389 31927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225fad4d487749949466e68cea3b3838" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42101 } }
I20260810 01:37:06.992605 31927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:06.992709 31927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:06.992821 31927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:06.993958 31927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225fad4d487749949466e68cea3b3838" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42101 } }
I20260810 01:37:06.994319 31927 leader_election.cc:302] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 225fad4d487749949466e68cea3b3838; no voters:
I20260810 01:37:06.994624 31927 leader_election.cc:288] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:06.994740 31933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:06.994964 31933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [term 1 LEADER]: Becoming Leader. State: Replica: 225fad4d487749949466e68cea3b3838, State: Running, Role: LEADER
I20260810 01:37:06.995280 31933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225fad4d487749949466e68cea3b3838" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42101 } }
I20260810 01:37:06.995949 31927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:06.997038 31935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 225fad4d487749949466e68cea3b3838. Latest consensus state: current_term: 1 leader_uuid: "225fad4d487749949466e68cea3b3838" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225fad4d487749949466e68cea3b3838" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42101 } } }
I20260810 01:37:06.997200 31935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:06.997488 31934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "225fad4d487749949466e68cea3b3838" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225fad4d487749949466e68cea3b3838" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42101 } } }
I20260810 01:37:06.997571 31934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:06.997619 31943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:07.002558 31943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:07.008496 31943 catalog_manager.cc:1347] Generated new cluster ID: 79b91507e648498aab63d5a9abc4a2a9
I20260810 01:37:07.008589 31943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:07.019977 31943 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:07.021239 31943 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:07.036870 31943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838: Generated new TSK 0
I20260810 01:37:07.037750 31943 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:37:07.073246 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42101
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:07.188825 31957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:07.189069 31957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:07.189118 31957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:07.193091 31957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:07.193176 31957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:07.193233 31957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:07.198457 31957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:07.199419 31957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:07.200481 31957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:37:07.209990 31957 server_base.cc:1034] running on GCE node
W20260810 01:37:07.210013 31965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:07.209964 31966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:07.210160 31968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:07.210671 31957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:07.211313 31957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:07.212502 31957 hybrid_clock.cc:648] HybridClock initialized: now 1786325827212488 us; error 33 us; skew 500 ppm
Aug 10 01:37:07 dist-test-slave-t3q3 krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325827, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:07.215536 31957 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:37:07.216367 31957 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:07.216434 31957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:07.216605 31957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:07.218611 31957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "9624a75dc0d54877b05a9d3d5242b1c8"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "0e6fc2a0944a77bbd8b5ce1905effe76"
server_key_iv: "899a3039b44a7558070fdd851a6bfa72"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.219123 31957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "9624a75dc0d54877b05a9d3d5242b1c8"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "0e6fc2a0944a77bbd8b5ce1905effe76"
server_key_iv: "899a3039b44a7558070fdd851a6bfa72"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.222810 31957 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:37:07.225160 31976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.226353 31957 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:07.226472 31957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "9624a75dc0d54877b05a9d3d5242b1c8"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "0e6fc2a0944a77bbd8b5ce1905effe76"
server_key_iv: "899a3039b44a7558070fdd851a6bfa72"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.226574 31957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:07.238147 31957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:07.241039 31957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:07.241235 31957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:07.241791 31957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:07.242597 31957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:07.242646 31957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.242713 31957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:07.242744 31957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.252382 31957 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:34153
I20260810 01:37:07.252408 32144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:34153 every 8 connection(s)
I20260810 01:37:07.252988 31957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:07.260819 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 31957
I20260810 01:37:07.260968 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:07.261339 25398 external_mini_cluster.cc:1428] Setting key 2445e88abe605d91f29fe4332fc5d45c
Aug 10 01:37:07 dist-test-slave-t3q3 krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325827, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:07.266712 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.254655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:39407 (local address 127.24.205.190:42101)
0810 01:37:07.254806 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.254809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.255973 (+ 1164us) server_negotiation.cc:407] Connection header received
0810 01:37:07.256809 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.256812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.256860 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.256937 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:07.258048 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.258569 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.259690 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.259920 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.259992 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.262718 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:07.262722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:07.262724 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:07.262750 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:07.264240 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.264874 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.264876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.264878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.265005 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.265411 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.265415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.265418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.265693 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:07.265802 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.266295 (+ 493us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.266456 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:37:07.267295 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.255039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42101 (local address 127.24.205.129:39407)
0810 01:37:07.255826 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.255866 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.256624 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.257099 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.257106 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.257455 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:07.257911 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.257923 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.258676 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.258679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.259583 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.259593 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.260041 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.260043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.260259 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.260776 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:07.260798 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:07.262506 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:07.264360 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:07.264369 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:07.264386 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:07.264774 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:07.265131 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:07.265137 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:07.265142 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:07.265309 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:07.265800 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:07.265805 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:07.266029 (+ 224us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.266201 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.266452 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":112,"threads_started":1}
I20260810 01:37:07.268546 32146 heartbeater.cc:347] Connected to a master server at 127.24.205.190:42101
I20260810 01:37:07.268803 32146 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:07.269248 32146 heartbeater.cc:511] Master 127.24.205.190:42101 requested a full tablet report, sending...
I20260810 01:37:07.270761 31866 ts_manager.cc:194] Registered new tserver with Master: 9624a75dc0d54877b05a9d3d5242b1c8 (127.24.205.129:34153)
I20260810 01:37:07.271894 31866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:39407
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:37:07.290900 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42101
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:07.408099 32152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:07.408444 32152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:07.408526 32152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:07.412513 32152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:07.412572 32152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:07.412704 32152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:07.418339 32152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:07.419456 32152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:07.420558 32152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:07.430198 32162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:07.430267 32152 server_base.cc:1034] running on GCE node
W20260810 01:37:07.430176 32165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:07.430460 32169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:07.430929 32152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:07.431563 32152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:07.432724 32152 hybrid_clock.cc:648] HybridClock initialized: now 1786325827432710 us; error 26 us; skew 500 ppm
Aug 10 01:37:07 dist-test-slave-t3q3 krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325827, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:07.435614 32152 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:37:07.436465 32152 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:07.436534 32152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:07.436762 32152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:07.438817 32152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "14395e35b5e44ec68e3589860fedc8e9"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "2b98289a2e13c19ce22ed91f0186ef51"
server_key_iv: "ae6d6699cb2cae85113a5852b9046ef0"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.439433 32152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "14395e35b5e44ec68e3589860fedc8e9"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "2b98289a2e13c19ce22ed91f0186ef51"
server_key_iv: "ae6d6699cb2cae85113a5852b9046ef0"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.443106 32152 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:37:07.445600 32180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.446851 32152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:07.446973 32152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "14395e35b5e44ec68e3589860fedc8e9"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "2b98289a2e13c19ce22ed91f0186ef51"
server_key_iv: "ae6d6699cb2cae85113a5852b9046ef0"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.447081 32152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:07.478912 32152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:07.482019 32152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:07.482244 32152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:07.482872 32152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:07.483763 32152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:07.483814 32152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.483855 32152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:07.483870 32152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.493373 32152 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:35115
I20260810 01:37:07.493402 32356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:35115 every 8 connection(s)
I20260810 01:37:07.493993 32152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:07.497906 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 32152
I20260810 01:37:07.498030 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:07.498394 25398 external_mini_cluster.cc:1428] Setting key 01b202b00439ebb6c804f3352bacc57b
Aug 10 01:37:07 dist-test-slave-t3q3 krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325827, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:07.508889 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.495768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:49303 (local address 127.24.205.190:42101)
0810 01:37:07.495945 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.495950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.497362 (+ 1412us) server_negotiation.cc:407] Connection header received
0810 01:37:07.498306 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.498310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.498368 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.498468 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:07.499814 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.500620 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.501801 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.502155 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.502248 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.505203 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:07.505207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:07.505210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:07.505244 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:07.506732 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.507274 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.507282 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.507285 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.507361 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.507717 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.507721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.507723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.507908 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:07.508020 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.508562 (+ 542us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.508714 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:37:07.509759 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.496252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42101 (local address 127.24.205.130:49303)
0810 01:37:07.497204 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.497269 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.498053 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.498647 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.498654 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.499131 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:07.499644 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.499664 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.500774 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.500777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.501675 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.501684 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.502325 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.502332 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.502564 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.503318 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:07.503334 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:07.505024 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:07.506861 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:07.506868 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:07.506882 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:07.507157 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:07.507467 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:07.507470 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:07.507472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:07.507616 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:07.508031 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:07.508039 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:07.508315 (+ 276us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.508517 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.508847 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":115,"threads_started":1}
I20260810 01:37:07.510941 32359 heartbeater.cc:347] Connected to a master server at 127.24.205.190:42101
I20260810 01:37:07.511229 32359 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:37:07.511746 32359 heartbeater.cc:511] Master 127.24.205.190:42101 requested a full tablet report, sending...
I20260810 01:37:07.512995 31866 ts_manager.cc:194] Registered new tserver with Master: 14395e35b5e44ec68e3589860fedc8e9 (127.24.205.130:35115)
I20260810 01:37:07.513872 31866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:49303
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:37:07.528896 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42101
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:07.642303 32367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:07.642582 32367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:07.642658 32367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:07.646777 32367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:07.646862 32367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:07.646950 32367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:07.652324 32367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:07.653386 32367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:07.654428 32367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:07.664003 32376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:07.664096 32372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:07.664116 32367 server_base.cc:1034] running on GCE node
W20260810 01:37:07.664012 32378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:07.664701 32367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:07.665378 32367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:07.666570 32367 hybrid_clock.cc:648] HybridClock initialized: now 1786325827666550 us; error 31 us; skew 500 ppm
Aug 10 01:37:07 dist-test-slave-t3q3 krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325827, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:07.669538 32367 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:37:07.670226 32367 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:07.670291 32367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:07.670455 32367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:07.672529 32367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "d6fdc33338cd4da5a2ddefacc9fd4269"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "d194c55c78a7db1f9d1018093205114b"
server_key_iv: "b843592d240ed51cadde8150ccaaebb3"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.673081 32367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "d6fdc33338cd4da5a2ddefacc9fd4269"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "d194c55c78a7db1f9d1018093205114b"
server_key_iv: "b843592d240ed51cadde8150ccaaebb3"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.676816 32367 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:37:07.679167 32386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.680444 32367 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:07.680570 32367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "d6fdc33338cd4da5a2ddefacc9fd4269"
format_stamp: "Formatted at 2026-08-10 01:37:07 on dist-test-slave-t3q3"
server_key: "d194c55c78a7db1f9d1018093205114b"
server_key_iv: "b843592d240ed51cadde8150ccaaebb3"
server_key_version: "encryptionkey@0"
I20260810 01:37:07.680678 32367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:07.697356 32367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:07.700742 32367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:07.700958 32367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:07.701562 32367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:07.702423 32367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:07.702471 32367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.702512 32367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:07.702567 32367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:07.711513 32367 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:33765
I20260810 01:37:07.711540 32558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:33765 every 8 connection(s)
I20260810 01:37:07.712282 32367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:07.716310 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 32367
I20260810 01:37:07.716461 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:07.716769 25398 external_mini_cluster.cc:1428] Setting key fbbeef76528df135b73a3223182f3b61
Aug 10 01:37:07 dist-test-slave-t3q3 krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325827, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:07.727197 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.714160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:47773 (local address 127.24.205.190:42101)
0810 01:37:07.714298 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.714302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.715600 (+ 1298us) server_negotiation.cc:407] Connection header received
0810 01:37:07.716787 (+ 1187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.716790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.716855 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.716964 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:07.718503 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.719061 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.720324 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.720562 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.720678 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.723243 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:07.723254 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:07.723257 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:07.723285 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:07.724805 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.725409 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.725416 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.725422 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.725512 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.725931 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.725936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.725938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.726163 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:07.726288 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.726860 (+ 572us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.727000 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:37:07.728152 32563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.714445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42101 (local address 127.24.205.131:47773)
0810 01:37:07.715383 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.715452 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.716534 (+ 1082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.717162 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.717169 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.717737 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:07.718361 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.718378 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.719195 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.719198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.720199 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.720210 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.720722 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.720727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.720923 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.721480 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:07.721515 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:07.723053 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:07.724943 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:07.724949 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:07.724968 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:07.725277 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:07.725629 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:07.725632 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:07.725635 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:07.725816 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:07.726289 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:07.726298 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:07.726582 (+ 284us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.726812 (+ 230us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.727188 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":129,"threads_started":1}
I20260810 01:37:07.729518 32561 heartbeater.cc:347] Connected to a master server at 127.24.205.190:42101
I20260810 01:37:07.729785 32561 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:07.730381 32561 heartbeater.cc:511] Master 127.24.205.190:42101 requested a full tablet report, sending...
I20260810 01:37:07.731534 31866 ts_manager.cc:194] Registered new tserver with Master: d6fdc33338cd4da5a2ddefacc9fd4269 (127.24.205.131:33765)
I20260810 01:37:07.732224 31866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:47773
I20260810 01:37:07.742424 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:37:07.752296 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.744486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57088 (local address 127.24.205.190:42101)
0810 01:37:07.744651 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.744658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.744909 (+ 251us) server_negotiation.cc:407] Connection header received
0810 01:37:07.745018 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.745020 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.745061 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.745148 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:07.745967 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.746503 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.747293 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.747501 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.747579 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.749008 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:07.749011 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:07.749013 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:07.749036 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:07.750406 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.750852 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.750856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.750857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.750947 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:07.751314 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:07.751317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:07.751319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:07.751559 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:07.751717 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.751961 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.752115 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:37:07.755343 31866 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:37:07.758419 31866 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:07.774044 32582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.767621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41940 (local address 127.24.205.131:33765)
0810 01:37:07.768203 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.768217 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.768421 (+ 204us) server_negotiation.cc:407] Connection header received
0810 01:37:07.768492 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.768497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.768659 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.768806 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:07.769246 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.770459 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.772271 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.773168 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.773302 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.773441 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.773771 (+ 330us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.773872 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":148,"threads_started":1}
I20260810 01:37:07.774037 32579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.767154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:34153 (local address 127.0.0.1:45708)
0810 01:37:07.768002 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.768082 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.768223 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.768792 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.768798 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.768820 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:07.768982 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.768991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.770580 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.770583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.772274 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.772286 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.773309 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.773313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.773514 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.773589 (+ 75us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.773718 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.773884 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"mutex_wait_us":350,"thread_start_us":106,"threads_started":1}
I20260810 01:37:07.774128 32581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.767303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45708 (local address 127.24.205.129:34153)
0810 01:37:07.767987 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.767994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.768279 (+ 285us) server_negotiation.cc:407] Connection header received
0810 01:37:07.768368 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.768377 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.768596 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.769162 (+ 566us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:07.769309 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.770466 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.772404 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.773178 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.773302 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.773441 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.773876 (+ 435us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.773981 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":86,"threads_started":1}
I20260810 01:37:07.774596 32584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.767220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:33765 (local address 127.0.0.1:41940)
0810 01:37:07.768206 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.768221 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.768329 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.768992 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.768995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.769011 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:07.769120 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.769126 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.770638 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.770641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.772136 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.772153 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.773309 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.773313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.773538 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.773588 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.773718 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.774470 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"mutex_wait_us":315,"thread_start_us":129,"threads_started":1}
I20260810 01:37:07.775828 32580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.767944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:35115 (local address 127.0.0.1:50716)
0810 01:37:07.768467 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.768481 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.768561 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.769307 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.769310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.769334 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:07.769424 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.769429 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.770511 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.770518 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.772274 (+ 1756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.772286 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.775545 (+ 3259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.775548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.775616 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.775639 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.775685 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.775736 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"mutex_wait_us":210,"thread_start_us":123,"threads_started":1}
I20260810 01:37:07.776501 32585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.768511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50716 (local address 127.24.205.130:35115)
0810 01:37:07.768831 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.768843 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.768867 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:37:07.768942 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.768946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.769145 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.769547 (+ 402us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:07.769679 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.770375 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.773510 (+ 3135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.774548 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.776165 (+ 1617us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.776272 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.776314 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.776383 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":138,"threads_started":1}
I20260810 01:37:07.777513 32053 tablet_service.cc:1467] Processing CreateTablet for tablet 4caebf7514584d0c8ab64e7c8c39d899 (DEFAULT_TABLE table=test-table [id=1eff140538184d61a0554c031be69892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:07.777519 32466 tablet_service.cc:1467] Processing CreateTablet for tablet 4caebf7514584d0c8ab64e7c8c39d899 (DEFAULT_TABLE table=test-table [id=1eff140538184d61a0554c031be69892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:07.778731 32053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4caebf7514584d0c8ab64e7c8c39d899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:07.778734 32466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4caebf7514584d0c8ab64e7c8c39d899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:07.778829 32256 tablet_service.cc:1467] Processing CreateTablet for tablet 4caebf7514584d0c8ab64e7c8c39d899 (DEFAULT_TABLE table=test-table [id=1eff140538184d61a0554c031be69892]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:07.779917 32256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4caebf7514584d0c8ab64e7c8c39d899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:07.786101 32586 tablet_bootstrap.cc:492] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Bootstrap starting.
I20260810 01:37:07.786885 32588 tablet_bootstrap.cc:492] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8: Bootstrap starting.
I20260810 01:37:07.788362 32586 tablet_bootstrap.cc:654] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:07.788965 32588 tablet_bootstrap.cc:654] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:07.789497 32586 log.cc:824] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:07.789866 32588 log.cc:824] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:07.790309 32590 tablet_bootstrap.cc:492] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Bootstrap starting.
I20260810 01:37:07.791760 32586 tablet_bootstrap.cc:492] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: No bootstrap required, opened a new log
I20260810 01:37:07.791980 32586 ts_tablet_manager.cc:1397] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:37:07.792301 32588 tablet_bootstrap.cc:492] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8: No bootstrap required, opened a new log
I20260810 01:37:07.792450 32590 tablet_bootstrap.cc:654] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:07.792629 32588 ts_tablet_manager.cc:1397] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:37:07.793684 32590 log.cc:824] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:07.795989 32590 tablet_bootstrap.cc:492] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: No bootstrap required, opened a new log
I20260810 01:37:07.796219 32590 ts_tablet_manager.cc:1397] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:37:07.796118 32586 raft_consensus.cc:348] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.796429 32586 raft_consensus.cc:374] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:07.796491 32586 raft_consensus.cc:729] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14395e35b5e44ec68e3589860fedc8e9, State: Initialized, Role: FOLLOWER
I20260810 01:37:07.797109 32586 consensus_queue.cc:260] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.797354 32588 raft_consensus.cc:348] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.797612 32588 raft_consensus.cc:374] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:07.797686 32588 raft_consensus.cc:729] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9624a75dc0d54877b05a9d3d5242b1c8, State: Initialized, Role: FOLLOWER
I20260810 01:37:07.798141 32359 heartbeater.cc:503] Master 127.24.205.190:42101 was elected leader, sending a full tablet report...
I20260810 01:37:07.798301 32586 ts_tablet_manager.cc:1428] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:37:07.799193 32588 consensus_queue.cc:260] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.799960 32146 heartbeater.cc:503] Master 127.24.205.190:42101 was elected leader, sending a full tablet report...
I20260810 01:37:07.800275 32588 ts_tablet_manager.cc:1428] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 01:37:07.801154 32590 raft_consensus.cc:348] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.801443 32590 raft_consensus.cc:374] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:07.801514 32590 raft_consensus.cc:729] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6fdc33338cd4da5a2ddefacc9fd4269, State: Initialized, Role: FOLLOWER
I20260810 01:37:07.801949 32590 consensus_queue.cc:260] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.802938 32561 heartbeater.cc:503] Master 127.24.205.190:42101 was elected leader, sending a full tablet report...
I20260810 01:37:07.802987 32590 ts_tablet_manager.cc:1428] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260810 01:37:07.845533 32598 raft_consensus.cc:482] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:07.845767 32598 raft_consensus.cc:504] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.846938 32598 leader_election.cc:288] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6fdc33338cd4da5a2ddefacc9fd4269 (127.24.205.131:33765), 14395e35b5e44ec68e3589860fedc8e9 (127.24.205.130:35115)
I20260810 01:37:07.851255 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.847214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:33765 (local address 127.24.205.129:49277)
0810 01:37:07.847669 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.847684 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.847807 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.848136 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.848140 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.848159 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:07.848310 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.848317 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.849153 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.849156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.850133 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.850147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.850768 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.850772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.850873 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.850916 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.850988 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.851066 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":24,"thread_start_us":146,"threads_started":1}
I20260810 01:37:07.851274 32582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.847326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:49277 (local address 127.24.205.131:33765)
0810 01:37:07.847494 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.847499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.847781 (+ 282us) server_negotiation.cc:407] Connection header received
0810 01:37:07.847924 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.847927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.848015 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.848123 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:07.848436 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.849016 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.850283 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.850668 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.850761 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.850802 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.851046 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.851123 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 01:37:07.851488 32585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.847368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:40963 (local address 127.24.205.130:35115)
0810 01:37:07.847492 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.847498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.847919 (+ 421us) server_negotiation.cc:407] Connection header received
0810 01:37:07.848041 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.848043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.848136 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.848217 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:07.848532 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.849019 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.850201 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.850835 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.850959 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.851014 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.851298 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.851381 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:37:07.851552 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.847220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:35115 (local address 127.24.205.129:40963)
0810 01:37:07.847784 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.847800 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:07.847935 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:07.848253 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:07.848256 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:07.848275 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:07.848409 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.848417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.849136 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.849141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.850102 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:07.850112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.850998 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.851004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:07.851108 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.851131 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:37:07.851211 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 01:37:07.851268 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":255,"thread_start_us":165,"threads_started":1}
I20260810 01:37:07.851928 32493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4caebf7514584d0c8ab64e7c8c39d899" candidate_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" is_pre_election: true
I20260810 01:37:07.852169 32289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4caebf7514584d0c8ab64e7c8c39d899" candidate_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14395e35b5e44ec68e3589860fedc8e9" is_pre_election: true
I20260810 01:37:07.852295 32493 raft_consensus.cc:2454] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9624a75dc0d54877b05a9d3d5242b1c8 in term 0.
I20260810 01:37:07.852418 32289 raft_consensus.cc:2454] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9624a75dc0d54877b05a9d3d5242b1c8 in term 0.
I20260810 01:37:07.852880 31977 leader_election.cc:302] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 14395e35b5e44ec68e3589860fedc8e9, 9624a75dc0d54877b05a9d3d5242b1c8, d6fdc33338cd4da5a2ddefacc9fd4269; no voters:
I20260810 01:37:07.853223 32598 raft_consensus.cc:2781] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:07.853324 32598 raft_consensus.cc:482] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:07.853385 32598 raft_consensus.cc:3037] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:07.854444 32598 raft_consensus.cc:504] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.854804 32598 leader_election.cc:288] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [CANDIDATE]: Term 1 election: Requested vote from peers d6fdc33338cd4da5a2ddefacc9fd4269 (127.24.205.131:33765), 14395e35b5e44ec68e3589860fedc8e9 (127.24.205.130:35115)
I20260810 01:37:07.855178 32289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4caebf7514584d0c8ab64e7c8c39d899" candidate_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14395e35b5e44ec68e3589860fedc8e9"
I20260810 01:37:07.855178 32493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4caebf7514584d0c8ab64e7c8c39d899" candidate_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269"
I20260810 01:37:07.855307 32289 raft_consensus.cc:3037] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:07.855307 32493 raft_consensus.cc:3037] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:07.856720 32289 raft_consensus.cc:2454] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9624a75dc0d54877b05a9d3d5242b1c8 in term 1.
I20260810 01:37:07.856720 32493 raft_consensus.cc:2454] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9624a75dc0d54877b05a9d3d5242b1c8 in term 1.
I20260810 01:37:07.857050 31977 leader_election.cc:302] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 14395e35b5e44ec68e3589860fedc8e9, 9624a75dc0d54877b05a9d3d5242b1c8, d6fdc33338cd4da5a2ddefacc9fd4269; no voters:
I20260810 01:37:07.857242 32598 raft_consensus.cc:2781] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:07.857455 32598 raft_consensus.cc:686] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [term 1 LEADER]: Becoming Leader. State: Replica: 9624a75dc0d54877b05a9d3d5242b1c8, State: Running, Role: LEADER
I20260810 01:37:07.857786 32598 consensus_queue.cc:237] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } }
I20260810 01:37:07.861079 31866 catalog_manager.cc:5495] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9624a75dc0d54877b05a9d3d5242b1c8 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624a75dc0d54877b05a9d3d5242b1c8" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260810 01:37:07.872361 32581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.868959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45718 (local address 127.24.205.129:34153)
0810 01:37:07.869092 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:07.869096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:07.869109 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:07.869182 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:07.869184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:07.869233 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:07.869319 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:07.869547 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.870037 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.870865 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:07.871069 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:07.871142 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:07.871408 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:07.871817 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:07.871908 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:07.872126 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 01:37:07.872199 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:37:07.878271 32289 raft_consensus.cc:1261] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 1 FOLLOWER]: Refusing update from remote peer 9624a75dc0d54877b05a9d3d5242b1c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:07.878270 32493 raft_consensus.cc:1261] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 1 FOLLOWER]: Refusing update from remote peer 9624a75dc0d54877b05a9d3d5242b1c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:07.879026 32603 consensus_queue.cc:1035] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14395e35b5e44ec68e3589860fedc8e9" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:07.879225 32598 consensus_queue.cc:1035] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6fdc33338cd4da5a2ddefacc9fd4269" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:07.888497 32609 mvcc.cc:205] Tried to move back new op lower bound from 7316790590982258688 to 7316790590908301312. Current Snapshot: MvccSnapshot[applied={T|T < 7316790590982258688}]
I20260810 01:37:07.890143 32608 mvcc.cc:205] Tried to move back new op lower bound from 7316790590982258688 to 7316790590908301312. Current Snapshot: MvccSnapshot[applied={T|T < 7316790590982258688}]
I20260810 01:37:07.895125 31866 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:07.895282 31866 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:07.897858 31866 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 225fad4d487749949466e68cea3b3838: Sending DeleteTablet for 3 replicas of tablet 4caebf7514584d0c8ab64e7c8c39d899
I20260810 01:37:07.898682 32466 tablet_service.cc:1514] Processing DeleteTablet for tablet 4caebf7514584d0c8ab64e7c8c39d899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:07 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:41940
I20260810 01:37:07.898725 32256 tablet_service.cc:1514] Processing DeleteTablet for tablet 4caebf7514584d0c8ab64e7c8c39d899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:07 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:50716
I20260810 01:37:07.898886 32053 tablet_service.cc:1514] Processing DeleteTablet for tablet 4caebf7514584d0c8ab64e7c8c39d899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:07 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:45708
I20260810 01:37:07.899415 32626 tablet_replica.cc:330] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: stopping tablet replica
I20260810 01:37:07.899693 32627 tablet_replica.cc:330] T 4caebf7514584d0c8ab64e7c8c39d899 P 9624a75dc0d54877b05a9d3d5242b1c8: stopping tablet replica
I20260810 01:37:07.899755 32626 raft_consensus.cc:2229] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:07.899855 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 31957
I20260810 01:37:07.900067 32626 raft_consensus.cc:2258] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:07.910483 32622 tablet_replica.cc:330] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: stopping tablet replica
I20260810 01:37:07.910864 32622 raft_consensus.cc:2229] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:07.911216 32622 raft_consensus.cc:2258] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:07.911831 32626 ts_tablet_manager.cc:1905] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:07.912789 32622 ts_tablet_manager.cc:1905] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:07.914876 32626 ts_tablet_manager.cc:1918] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:07.914983 32626 log.cc:1196] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/4caebf7514584d0c8ab64e7c8c39d899
I20260810 01:37:07.915330 32626 ts_tablet_manager.cc:1939] T 4caebf7514584d0c8ab64e7c8c39d899 P d6fdc33338cd4da5a2ddefacc9fd4269: Deleting consensus metadata
I20260810 01:37:07.915723 32622 ts_tablet_manager.cc:1918] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:07.915823 32622 log.cc:1196] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/4caebf7514584d0c8ab64e7c8c39d899
I20260810 01:37:07.916203 32622 ts_tablet_manager.cc:1939] T 4caebf7514584d0c8ab64e7c8c39d899 P 14395e35b5e44ec68e3589860fedc8e9: Deleting consensus metadata
I20260810 01:37:07.916858 31845 catalog_manager.cc:4841] TS d6fdc33338cd4da5a2ddefacc9fd4269 (127.24.205.131:33765): tablet 4caebf7514584d0c8ab64e7c8c39d899 (table test-table [id=1eff140538184d61a0554c031be69892]) successfully deleted
I20260810 01:37:07.917383 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 32152
I20260810 01:37:07.925271 31847 catalog_manager.cc:4841] TS 14395e35b5e44ec68e3589860fedc8e9 (127.24.205.130:35115): tablet 4caebf7514584d0c8ab64e7c8c39d899 (table test-table [id=1eff140538184d61a0554c031be69892]) successfully deleted
W20260810 01:37:07.925614 31847 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:34153 (error 108)
I20260810 01:37:07.926649 32580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:07.926379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:34153 (local address 127.0.0.1:45720)
0810 01:37:07.926509 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:07.926573 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:34153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 01:37:07.926921 31847 catalog_manager.cc:4584] TS 9624a75dc0d54877b05a9d3d5242b1c8 (127.24.205.129:34153): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4caebf7514584d0c8ab64e7c8c39d899: Network error: Client connection negotiation failed: client connection to 127.24.205.129:34153: connect: Connection refused (error 111)
I20260810 01:37:07.931217 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 32367
I20260810 01:37:07.942112 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 31821
2026-08-10T01:37:07Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2553 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T01:37:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:07Z Disabled control of system clock
I20260810 01:37:07.981688 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38435
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:46083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:38435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 01:37:08.092896 32635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:08.093232 32635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:08.093272 32635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:08.097198 32635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:08.097250 32635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:08.097265 32635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:08.097282 32635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:08.097297 32635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:08.101938 32635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:38435
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:08.102964 32635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:08.104318 32635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:08.112758 32645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:08.112744 32643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:08.112811 32642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:08.112778 32635 server_base.cc:1034] running on GCE node
I20260810 01:37:08.113550 32635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:08.114557 32635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:08.115764 32635 hybrid_clock.cc:648] HybridClock initialized: now 1786325828115754 us; error 30 us; skew 500 ppm
I20260810 01:37:08.117712 32635 webserver.cc:460] Webserver started at http://127.24.205.190:44081/ using document root <none> and password file <none>
I20260810 01:37:08.118290 32635 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:08.118389 32635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:08.118631 32635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:08.120720 32635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "5024d5a0068a4c8bb45a7721cb637ee2"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "afb49d874fc7d2267ff8ce261cd35a9e"
server_key_iv: "08d022be67a13aab90ec57f34116da98"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.121301 32635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "5024d5a0068a4c8bb45a7721cb637ee2"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "afb49d874fc7d2267ff8ce261cd35a9e"
server_key_iv: "08d022be67a13aab90ec57f34116da98"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.124972 32635 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:37:08.127319 32652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.128569 32635 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:08.128717 32635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "5024d5a0068a4c8bb45a7721cb637ee2"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "afb49d874fc7d2267ff8ce261cd35a9e"
server_key_iv: "08d022be67a13aab90ec57f34116da98"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.128831 32635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:08.133327 32635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:08.133914 32635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:08.134104 32635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:08.140930 32635 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:38435
I20260810 01:37:08.140939 32730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:38435 every 8 connection(s)
I20260810 01:37:08.141836 32635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:08.145563 32731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:08.147347 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 32635
I20260810 01:37:08.147490 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:08.147768 25398 external_mini_cluster.cc:1428] Setting key 859eb7ad65edf80c55d2e40c36f970b4
I20260810 01:37:08.151587 32731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2: Bootstrap starting.
I20260810 01:37:08.153497 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.149282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57228 (local address 127.24.205.190:38435)
0810 01:37:08.149938 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.149953 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.149986 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:37:08.150797 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.150816 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.151157 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.151496 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.152258 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.152262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.152274 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.152283 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.152333 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.152348 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.152508 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.152581 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.152828 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":131,"threads_started":1}
I20260810 01:37:08.154428 32731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:08.155182 32731 log.cc:824] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:08.157187 32731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2: No bootstrap required, opened a new log
I20260810 01:37:08.160713 32731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38435 } }
I20260810 01:37:08.160957 32731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:08.161044 32731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5024d5a0068a4c8bb45a7721cb637ee2, State: Initialized, Role: FOLLOWER
I20260810 01:37:08.161475 32731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38435 } }
I20260810 01:37:08.161633 32731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:08.161731 32731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:08.161851 32731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:08.162738 32731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38435 } }
I20260810 01:37:08.163087 32731 leader_election.cc:302] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5024d5a0068a4c8bb45a7721cb637ee2; no voters:
I20260810 01:37:08.163439 32731 leader_election.cc:288] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:08.163517 32738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:08.163802 32738 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [term 1 LEADER]: Becoming Leader. State: Replica: 5024d5a0068a4c8bb45a7721cb637ee2, State: Running, Role: LEADER
I20260810 01:37:08.164139 32738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38435 } }
I20260810 01:37:08.164722 32731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:08.165941 32743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5024d5a0068a4c8bb45a7721cb637ee2. Latest consensus state: current_term: 1 leader_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38435 } } }
I20260810 01:37:08.165970 32741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5024d5a0068a4c8bb45a7721cb637ee2" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38435 } } }
I20260810 01:37:08.166095 32743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:08.166105 32741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:08.166469 32754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:08.169454 32754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:08.174847 32754 catalog_manager.cc:1347] Generated new cluster ID: b904a9a84c094b0c85e82fa2610a3791
I20260810 01:37:08.174922 32754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:08.209862 32754 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:08.210287 32754 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:08.216586 32754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2: Generated new TSK 0
I20260810 01:37:08.217458 32754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:37:08.227723 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38435
--builtin_ntp_servers=127.24.205.148:46083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 01:37:08.343715 301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:08.344020 301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:08.344134 301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:08.348109 301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:08.348199 301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:08.348292 301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:08.352957 301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:08.354099 301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:08.355500 301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:08.365276 311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:08.365276 314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:08.365520 312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:08.365558 301 server_base.cc:1034] running on GCE node
I20260810 01:37:08.366222 301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:08.366887 301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:08.368090 301 hybrid_clock.cc:648] HybridClock initialized: now 1786325828368025 us; error 53 us; skew 500 ppm
I20260810 01:37:08.370002 301 webserver.cc:460] Webserver started at http://127.24.205.129:46449/ using document root <none> and password file <none>
I20260810 01:37:08.370608 301 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:08.370672 301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:08.371004 301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:08.373245 301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "db3c8fa41ce145878837cf6bd3ed1f16"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "12ec4194390ec8ae5fd633974535b01d"
server_key_iv: "ae2afaa20a20075d7165fac84fee8bf2"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.373906 301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "db3c8fa41ce145878837cf6bd3ed1f16"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "12ec4194390ec8ae5fd633974535b01d"
server_key_iv: "ae2afaa20a20075d7165fac84fee8bf2"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.378118 301 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:08.380690 327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.381903 301 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:08.382051 301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "db3c8fa41ce145878837cf6bd3ed1f16"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "12ec4194390ec8ae5fd633974535b01d"
server_key_iv: "ae2afaa20a20075d7165fac84fee8bf2"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.382161 301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:08.387147 301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:08.387748 301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:08.387929 301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:08.388576 301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:08.389549 301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:08.389596 301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.389664 301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:08.389698 301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.398710 301 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:35259
I20260810 01:37:08.398738 499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:35259 every 8 connection(s)
I20260810 01:37:08.399582 301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:08.405603 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 301
I20260810 01:37:08.405751 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:08.406087 25398 external_mini_cluster.cc:1428] Setting key 38c66bbe1324e28475fc19bd6f1f9a37
I20260810 01:37:08.406076 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.401485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:55791 (local address 127.24.205.190:38435)
0810 01:37:08.401624 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.401627 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.402618 (+ 991us) server_negotiation.cc:407] Connection header received
0810 01:37:08.404106 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.404110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.404169 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.404369 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.405573 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.405577 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.405579 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.405592 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.405622 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.405631 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.405733 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.405896 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.405943 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:37:08.407235 502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.401809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38435 (local address 127.24.205.129:55791)
0810 01:37:08.402453 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:08.402492 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:08.403829 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:08.404542 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:08.404549 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:08.404650 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:08.405298 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:08.405300 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:08.405340 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:08.405410 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:08.405716 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:08.405725 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:08.405731 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:37:08.405920 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 01:37:08.406245 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":116,"threads_started":1}
I20260810 01:37:08.408494 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38435
--builtin_ntp_servers=127.24.205.148:46083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 01:37:08.408735 500 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38435
I20260810 01:37:08.408977 500 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:08.409389 500 heartbeater.cc:511] Master 127.24.205.190:38435 requested a full tablet report, sending...
I20260810 01:37:08.411036 32680 ts_manager.cc:194] Registered new tserver with Master: db3c8fa41ce145878837cf6bd3ed1f16 (127.24.205.129:35259)
W20260810 01:37:08.521073 503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:08.521325 503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:08.521364 503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:08.525349 503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:08.525400 503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:08.525481 503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:08.530107 503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:08.531112 503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:08.532550 503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:08.541994 515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:08.542100 503 server_base.cc:1034] running on GCE node
W20260810 01:37:08.542037 517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:08.541966 511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:08.542675 503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:08.543251 503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:08.544440 503 hybrid_clock.cc:648] HybridClock initialized: now 1786325828544423 us; error 26 us; skew 500 ppm
I20260810 01:37:08.546337 503 webserver.cc:460] Webserver started at http://127.24.205.130:39275/ using document root <none> and password file <none>
I20260810 01:37:08.546921 503 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:08.547017 503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:08.547266 503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:08.549439 503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "fd03953815164950850397144472d5b2"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "1a2329ff61cd9f16b1f0bb97b42e3ee3"
server_key_iv: "557b135e6162ddb996c7d52443a33a02"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.550042 503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "fd03953815164950850397144472d5b2"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "1a2329ff61cd9f16b1f0bb97b42e3ee3"
server_key_iv: "557b135e6162ddb996c7d52443a33a02"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.553890 503 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:08.556486 525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.557706 503 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:08.557844 503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "fd03953815164950850397144472d5b2"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "1a2329ff61cd9f16b1f0bb97b42e3ee3"
server_key_iv: "557b135e6162ddb996c7d52443a33a02"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.557962 503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:08.562615 503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:08.563232 503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:08.563416 503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:08.563973 503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:08.564985 503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:08.565059 503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.565151 503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:08.565203 503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.574412 503 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:44043
I20260810 01:37:08.574474 692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:44043 every 8 connection(s)
I20260810 01:37:08.575345 503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:08.575981 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 503
I20260810 01:37:08.576146 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:08.576469 25398 external_mini_cluster.cc:1428] Setting key 300903d54be7b53c9bda91bd9e0414c9
I20260810 01:37:08.578612 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38435
--builtin_ntp_servers=127.24.205.148:46083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 01:37:08.582456 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.577485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:49535 (local address 127.24.205.190:38435)
0810 01:37:08.577618 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.577623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.578910 (+ 1287us) server_negotiation.cc:407] Connection header received
0810 01:37:08.580456 (+ 1546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.580459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.580496 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.580569 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.581864 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.581866 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.581869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.581880 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.581927 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.581941 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.582041 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.582214 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.582265 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:37:08.583330 695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.578036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38435 (local address 127.24.205.130:49535)
0810 01:37:08.578763 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:08.578816 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:08.580169 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:08.580766 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:08.580776 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:08.580897 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:08.581502 (+ 605us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:08.581506 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:08.581587 (+ 81us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:08.581697 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:08.582055 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:08.582064 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:08.582070 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:37:08.582224 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:37:08.582416 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":135,"threads_started":1}
I20260810 01:37:08.584584 693 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38435
I20260810 01:37:08.584808 693 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:08.585254 693 heartbeater.cc:511] Master 127.24.205.190:38435 requested a full tablet report, sending...
I20260810 01:37:08.586423 32680 ts_manager.cc:194] Registered new tserver with Master: fd03953815164950850397144472d5b2 (127.24.205.130:44043)
W20260810 01:37:08.697000 696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:08.697283 696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:08.697325 696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:08.701290 696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:08.701349 696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:08.701404 696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:08.706144 696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:38435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:08.707211 696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:08.708631 696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:08.718664 706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:08.718664 702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:08.718693 703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:08.718860 696 server_base.cc:1034] running on GCE node
I20260810 01:37:08.719254 696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:08.719914 696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:08.721097 696 hybrid_clock.cc:648] HybridClock initialized: now 1786325828721087 us; error 43 us; skew 500 ppm
I20260810 01:37:08.723112 696 webserver.cc:460] Webserver started at http://127.24.205.131:37229/ using document root <none> and password file <none>
I20260810 01:37:08.723714 696 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:08.723778 696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:08.724030 696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:08.726205 696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "c74be283c77e450a92930302628d01d3"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "1877c85d9d8347386cb35064274e31b2"
server_key_iv: "f4ca2315e258c1c7245c70063eea0b6c"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.726785 696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "c74be283c77e450a92930302628d01d3"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "1877c85d9d8347386cb35064274e31b2"
server_key_iv: "f4ca2315e258c1c7245c70063eea0b6c"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.730706 696 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 01:37:08.734474 713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.736471 696 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:37:08.736598 696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "c74be283c77e450a92930302628d01d3"
format_stamp: "Formatted at 2026-08-10 01:37:08 on dist-test-slave-t3q3"
server_key: "1877c85d9d8347386cb35064274e31b2"
server_key_iv: "f4ca2315e258c1c7245c70063eea0b6c"
server_key_version: "encryptionkey@0"
I20260810 01:37:08.736729 696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:08.742195 696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:08.742762 696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:08.742902 696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:08.743396 696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:08.744393 696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:08.744443 696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.744483 696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:08.744498 696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:08.753443 696 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:34567
I20260810 01:37:08.753471 892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:34567 every 8 connection(s)
I20260810 01:37:08.754402 696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:08.756726 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 696
I20260810 01:37:08.756845 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:08.757205 25398 external_mini_cluster.cc:1428] Setting key 325de277b7a96d1246997a4e0d641b98
I20260810 01:37:08.761101 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.756363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:41257 (local address 127.24.205.190:38435)
0810 01:37:08.756532 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.756535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.757853 (+ 1318us) server_negotiation.cc:407] Connection header received
0810 01:37:08.759424 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.759427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.759469 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.759550 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.760654 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.760658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.760660 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.760671 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.760697 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.760705 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.760779 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.760949 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.760996 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 01:37:08.762125 895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.756856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:38435 (local address 127.24.205.131:41257)
0810 01:37:08.757688 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:08.757746 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:08.759167 (+ 1421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:08.759728 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:08.759735 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:08.759827 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:08.760399 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:08.760400 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:08.760441 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:08.760508 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:08.760794 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:08.760802 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:08.760808 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:37:08.760975 (+ 167us) client_negotiation.cc:240] Negotiation successful
0810 01:37:08.761172 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":138,"threads_started":1}
I20260810 01:37:08.763232 893 heartbeater.cc:347] Connected to a master server at 127.24.205.190:38435
I20260810 01:37:08.763468 893 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:08.763885 893 heartbeater.cc:511] Master 127.24.205.190:38435 requested a full tablet report, sending...
I20260810 01:37:08.764997 32680 ts_manager.cc:194] Registered new tserver with Master: c74be283c77e450a92930302628d01d3 (127.24.205.131:34567)
I20260810 01:37:08.771152 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:37:08.774762 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.773169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.24.205.190:38435)
0810 01:37:08.773343 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.773348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.773497 (+ 149us) server_negotiation.cc:407] Connection header received
0810 01:37:08.773606 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.773608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.773641 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.773705 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.774382 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.774385 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.774387 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.774398 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.774415 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.774423 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.774491 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.774554 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.774585 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 01:37:08.777657 32680 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57242:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:37:08.780771 32680 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:08.793530 909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.789807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:44043 (local address 127.0.0.1:58756)
0810 01:37:08.790209 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:08.790250 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:08.790336 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:08.791714 (+ 1378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:08.791720 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:08.791798 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:08.792420 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:08.792422 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:08.792442 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:08.792512 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:08.793130 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:08.793141 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:08.793149 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 01:37:08.793269 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 01:37:08.793345 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":79,"threads_started":1}
I20260810 01:37:08.793546 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.790764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49740 (local address 127.24.205.129:35259)
0810 01:37:08.791216 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.791230 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.791255 (+ 25us) server_negotiation.cc:407] Connection header received
0810 01:37:08.791441 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.791448 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.791642 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.791783 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.792992 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.792997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.793007 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.793018 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.793088 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.793128 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.793242 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.793323 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.793393 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":159,"threads_started":1}
I20260810 01:37:08.793835 911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.789883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:34567 (local address 127.0.0.1:43740)
0810 01:37:08.790696 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:08.790710 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:08.790792 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:08.791878 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:08.791881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:08.791897 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:08.792833 (+ 936us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:08.792836 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:08.792847 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:08.792882 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:08.793273 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:08.793277 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:08.793282 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:37:08.793334 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 01:37:08.793356 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":116,"threads_started":1}
I20260810 01:37:08.794029 914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.790551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:35259 (local address 127.0.0.1:49740)
0810 01:37:08.790866 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:08.790880 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:08.790964 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:08.792150 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:08.792153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:08.792168 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:08.792656 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:08.792671 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:08.792681 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:08.792706 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:08.793215 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:08.793220 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:08.793224 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:37:08.793312 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 01:37:08.793354 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":101,"threads_started":1}
I20260810 01:37:08.794059 921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.791038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43740 (local address 127.24.205.131:34567)
0810 01:37:08.791494 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.791505 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.791526 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:37:08.791572 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.791577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.791727 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.792474 (+ 747us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.793069 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.793074 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.793084 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.793094 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.793132 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.793157 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.793539 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.793740 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.793820 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":161,"threads_started":1}
I20260810 01:37:08.794586 916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:08.790520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.24.205.130:44043)
0810 01:37:08.791217 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:08.791229 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:08.791255 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:37:08.791316 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:08.791322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:08.791533 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:08.791691 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:08.792858 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:08.792864 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:08.792877 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:08.792889 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:08.792935 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:08.792987 (+ 52us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:08.793107 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:08.794337 (+ 1230us) server_negotiation.cc:299] Negotiation successful
0810 01:37:08.794426 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":126,"threads_started":1}
I20260810 01:37:08.797977 595 tablet_service.cc:1467] Processing CreateTablet for tablet 84c9d416bd204b1c8c8faabbfb02b8a3 (DEFAULT_TABLE table=test-table [id=73db04d8c21b4dcfb50b6fc633855317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:08.798007 799 tablet_service.cc:1467] Processing CreateTablet for tablet 84c9d416bd204b1c8c8faabbfb02b8a3 (DEFAULT_TABLE table=test-table [id=73db04d8c21b4dcfb50b6fc633855317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:08.798977 595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c9d416bd204b1c8c8faabbfb02b8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:08.798978 799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c9d416bd204b1c8c8faabbfb02b8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:08.801826 403 tablet_service.cc:1467] Processing CreateTablet for tablet 84c9d416bd204b1c8c8faabbfb02b8a3 (DEFAULT_TABLE table=test-table [id=73db04d8c21b4dcfb50b6fc633855317]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:08.802893 403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84c9d416bd204b1c8c8faabbfb02b8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:08.805328 927 tablet_bootstrap.cc:492] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Bootstrap starting.
I20260810 01:37:08.806778 929 tablet_bootstrap.cc:492] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Bootstrap starting.
I20260810 01:37:08.807767 927 tablet_bootstrap.cc:654] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:08.808725 927 log.cc:824] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:08.809005 929 tablet_bootstrap.cc:654] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:08.809867 929 log.cc:824] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:08.810340 930 tablet_bootstrap.cc:492] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: Bootstrap starting.
I20260810 01:37:08.811419 927 tablet_bootstrap.cc:492] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: No bootstrap required, opened a new log
I20260810 01:37:08.811628 927 ts_tablet_manager.cc:1397] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260810 01:37:08.811901 929 tablet_bootstrap.cc:492] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: No bootstrap required, opened a new log
I20260810 01:37:08.812103 929 ts_tablet_manager.cc:1397] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:37:08.812292 930 tablet_bootstrap.cc:654] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:08.813019 930 log.cc:824] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:08.814766 930 tablet_bootstrap.cc:492] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: No bootstrap required, opened a new log
I20260810 01:37:08.815203 930 ts_tablet_manager.cc:1397] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:37:08.816387 927 raft_consensus.cc:348] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:08.816675 927 raft_consensus.cc:374] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:08.816557 929 raft_consensus.cc:348] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:08.816735 927 raft_consensus.cc:729] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74be283c77e450a92930302628d01d3, State: Initialized, Role: FOLLOWER
I20260810 01:37:08.816793 929 raft_consensus.cc:374] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:08.816847 929 raft_consensus.cc:729] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd03953815164950850397144472d5b2, State: Initialized, Role: FOLLOWER
I20260810 01:37:08.817211 929 consensus_queue.cc:260] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:08.817211 927 consensus_queue.cc:260] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:08.818217 893 heartbeater.cc:503] Master 127.24.205.190:38435 was elected leader, sending a full tablet report...
I20260810 01:37:08.818239 929 ts_tablet_manager.cc:1428] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:37:08.818243 927 ts_tablet_manager.cc:1428] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260810 01:37:08.819213 930 raft_consensus.cc:348] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:08.819411 693 heartbeater.cc:503] Master 127.24.205.190:38435 was elected leader, sending a full tablet report...
I20260810 01:37:08.819475 930 raft_consensus.cc:374] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:08.821346 930 raft_consensus.cc:729] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db3c8fa41ce145878837cf6bd3ed1f16, State: Initialized, Role: FOLLOWER
I20260810 01:37:08.821803 930 consensus_queue.cc:260] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:08.822861 930 ts_tablet_manager.cc:1428] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: Time spent starting tablet: real 0.008s user 0.000s sys 0.005s
I20260810 01:37:08.823227 500 heartbeater.cc:503] Master 127.24.205.190:38435 was elected leader, sending a full tablet report...
W20260810 01:37:08.826520 694 tablet.cc:2369] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:08.900815 501 tablet.cc:2369] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:09.005443 894 tablet.cc:2369] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:37:09.206646 938 raft_consensus.cc:482] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:09.206957 938 raft_consensus.cc:504] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:09.208227 938 leader_election.cc:288] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74be283c77e450a92930302628d01d3 (127.24.205.131:34567), db3c8fa41ce145878837cf6bd3ed1f16 (127.24.205.129:35259)
I20260810 01:37:09.210726 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.208714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:55525 (local address 127.24.205.129:35259)
0810 01:37:09.208962 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:09.208967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:09.209181 (+ 214us) server_negotiation.cc:407] Connection header received
0810 01:37:09.209303 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:09.209307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:09.209343 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:09.209428 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:09.210305 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:09.210309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:09.210312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:09.210325 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:09.210346 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:09.210357 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:09.210456 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:09.210549 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 01:37:09.210589 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260810 01:37:09.210726 921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.208842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:43689 (local address 127.24.205.131:34567)
0810 01:37:09.208988 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:09.208994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:09.209078 (+ 84us) server_negotiation.cc:407] Connection header received
0810 01:37:09.209231 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:09.209239 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:09.209301 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:09.209402 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:09.210305 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:09.210309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:09.210312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:09.210325 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:09.210346 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:09.210357 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:09.210456 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:09.210548 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 01:37:09.210589 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:37:09.210767 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.208584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:34567 (local address 127.24.205.130:43689)
0810 01:37:09.208960 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:09.208980 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:09.209113 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:09.209453 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:09.209456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:09.209474 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:09.210099 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:09.210102 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:09.210117 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:09.210151 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:09.210452 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:09.210455 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:09.210459 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:37:09.210543 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 01:37:09.210598 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":76,"threads_started":1}
I20260810 01:37:09.210767 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.208583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:35259 (local address 127.24.205.130:55525)
0810 01:37:09.209075 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:09.209089 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:09.209200 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:09.209453 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:09.209456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:09.209474 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:09.210134 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:09.210136 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:09.210143 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:09.210173 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:09.210452 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:09.210455 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:09.210459 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:37:09.210543 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 01:37:09.210607 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":76,"thread_start_us":118,"threads_started":1}
I20260810 01:37:09.211540 437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c9d416bd204b1c8c8faabbfb02b8a3" candidate_uuid: "fd03953815164950850397144472d5b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" is_pre_election: true
I20260810 01:37:09.211534 824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c9d416bd204b1c8c8faabbfb02b8a3" candidate_uuid: "fd03953815164950850397144472d5b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74be283c77e450a92930302628d01d3" is_pre_election: true
I20260810 01:37:09.211844 824 raft_consensus.cc:2454] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd03953815164950850397144472d5b2 in term 0.
I20260810 01:37:09.211858 437 raft_consensus.cc:2454] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd03953815164950850397144472d5b2 in term 0.
I20260810 01:37:09.212384 527 leader_election.cc:302] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: c74be283c77e450a92930302628d01d3, db3c8fa41ce145878837cf6bd3ed1f16, fd03953815164950850397144472d5b2; no voters:
I20260810 01:37:09.212706 938 raft_consensus.cc:2781] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:09.212795 938 raft_consensus.cc:482] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:09.212826 938 raft_consensus.cc:3037] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:09.213891 938 raft_consensus.cc:504] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:09.214216 938 leader_election.cc:288] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [CANDIDATE]: Term 1 election: Requested vote from peers c74be283c77e450a92930302628d01d3 (127.24.205.131:34567), db3c8fa41ce145878837cf6bd3ed1f16 (127.24.205.129:35259)
I20260810 01:37:09.214545 824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c9d416bd204b1c8c8faabbfb02b8a3" candidate_uuid: "fd03953815164950850397144472d5b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74be283c77e450a92930302628d01d3"
I20260810 01:37:09.214547 437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84c9d416bd204b1c8c8faabbfb02b8a3" candidate_uuid: "fd03953815164950850397144472d5b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db3c8fa41ce145878837cf6bd3ed1f16"
I20260810 01:37:09.214679 824 raft_consensus.cc:3037] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:09.214681 437 raft_consensus.cc:3037] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:09.215746 437 raft_consensus.cc:2454] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd03953815164950850397144472d5b2 in term 1.
I20260810 01:37:09.215754 824 raft_consensus.cc:2454] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd03953815164950850397144472d5b2 in term 1.
I20260810 01:37:09.216037 529 leader_election.cc:302] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db3c8fa41ce145878837cf6bd3ed1f16, fd03953815164950850397144472d5b2; no voters:
I20260810 01:37:09.216272 938 raft_consensus.cc:2781] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:09.216473 938 raft_consensus.cc:686] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 1 LEADER]: Becoming Leader. State: Replica: fd03953815164950850397144472d5b2, State: Running, Role: LEADER
I20260810 01:37:09.216835 938 consensus_queue.cc:237] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } }
I20260810 01:37:09.219931 32679 catalog_manager.cc:5495] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd03953815164950850397144472d5b2 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "fd03953815164950850397144472d5b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd03953815164950850397144472d5b2" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 } health_report { overall_health: UNKNOWN } } }
I20260810 01:37:09.247800 916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.246306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58772 (local address 127.24.205.130:44043)
0810 01:37:09.246444 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:09.246448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:09.246462 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:37:09.246594 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:09.246596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:09.246655 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:09.246732 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:09.247415 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:09.247418 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:09.247420 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:09.247431 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:09.247451 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:09.247458 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:09.247532 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:09.247592 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 01:37:09.247625 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:37:09.254046 437 raft_consensus.cc:1261] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 1 FOLLOWER]: Refusing update from remote peer fd03953815164950850397144472d5b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:09.254046 824 raft_consensus.cc:1261] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 1 FOLLOWER]: Refusing update from remote peer fd03953815164950850397144472d5b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:09.254830 945 consensus_queue.cc:1035] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db3c8fa41ce145878837cf6bd3ed1f16" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:09.255061 938 consensus_queue.cc:1035] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74be283c77e450a92930302628d01d3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 34567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:09.264523 950 mvcc.cc:205] Tried to move back new op lower bound from 7316790596616052736 to 7316790596474781696. Current Snapshot: MvccSnapshot[applied={T|T < 7316790596616052736}]
I20260810 01:37:09.266249 949 mvcc.cc:205] Tried to move back new op lower bound from 7316790596616052736 to 7316790596474781696. Current Snapshot: MvccSnapshot[applied={T|T < 7316790596616052736}]
I20260810 01:37:09.271458 32679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:09.271652 32679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:09.274432 32679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5024d5a0068a4c8bb45a7721cb637ee2: Sending DeleteTablet for 3 replicas of tablet 84c9d416bd204b1c8c8faabbfb02b8a3
I20260810 01:37:09.275367 403 tablet_service.cc:1514] Processing DeleteTablet for tablet 84c9d416bd204b1c8c8faabbfb02b8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:09 UTC) from {username='slave'} at 127.0.0.1:49740
I20260810 01:37:09.275349 799 tablet_service.cc:1514] Processing DeleteTablet for tablet 84c9d416bd204b1c8c8faabbfb02b8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:09 UTC) from {username='slave'} at 127.0.0.1:43740
I20260810 01:37:09.275943 962 tablet_replica.cc:330] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: stopping tablet replica
I20260810 01:37:09.275920 595 tablet_service.cc:1514] Processing DeleteTablet for tablet 84c9d416bd204b1c8c8faabbfb02b8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:09 UTC) from {username='slave'} at 127.0.0.1:58756
I20260810 01:37:09.276293 963 tablet_replica.cc:330] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16: stopping tablet replica
I20260810 01:37:09.276379 962 raft_consensus.cc:2229] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:09.276618 963 raft_consensus.cc:2229] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:09.276758 962 raft_consensus.cc:2258] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:09.276962 963 raft_consensus.cc:2258] T 84c9d416bd204b1c8c8faabbfb02b8a3 P db3c8fa41ce145878837cf6bd3ed1f16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:09.277434 964 tablet_replica.cc:330] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: stopping tablet replica
I20260810 01:37:09.277498 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 301
I20260810 01:37:09.280679 964 raft_consensus.cc:2229] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:09.281176 964 raft_consensus.cc:2258] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:09.283953 964 ts_tablet_manager.cc:1905] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:09.286602 964 ts_tablet_manager.cc:1918] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:09.286743 964 log.cc:1196] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/84c9d416bd204b1c8c8faabbfb02b8a3
I20260810 01:37:09.287104 964 ts_tablet_manager.cc:1939] T 84c9d416bd204b1c8c8faabbfb02b8a3 P fd03953815164950850397144472d5b2: Deleting consensus metadata
I20260810 01:37:09.288919 32659 catalog_manager.cc:4841] TS fd03953815164950850397144472d5b2 (127.24.205.130:44043): tablet 84c9d416bd204b1c8c8faabbfb02b8a3 (table test-table [id=73db04d8c21b4dcfb50b6fc633855317]) successfully deleted
I20260810 01:37:09.292385 962 ts_tablet_manager.cc:1905] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:09.296651 962 ts_tablet_manager.cc:1918] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:09.296792 962 log.cc:1196] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/84c9d416bd204b1c8c8faabbfb02b8a3
I20260810 01:37:09.297266 962 ts_tablet_manager.cc:1939] T 84c9d416bd204b1c8c8faabbfb02b8a3 P c74be283c77e450a92930302628d01d3: Deleting consensus metadata
I20260810 01:37:09.299309 32656 catalog_manager.cc:4841] TS c74be283c77e450a92930302628d01d3 (127.24.205.131:34567): tablet 84c9d416bd204b1c8c8faabbfb02b8a3 (table test-table [id=73db04d8c21b4dcfb50b6fc633855317]) successfully deleted
W20260810 01:37:09.310098 32659 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:35259 (error 108)
I20260810 01:37:09.310186 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 503
I20260810 01:37:09.318202 970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.317750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:35259 (local address 127.0.0.1:49756)
0810 01:37:09.317992 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:09.318084 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:35259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":94,"threads_started":1}
W20260810 01:37:09.318449 32659 catalog_manager.cc:4584] TS db3c8fa41ce145878837cf6bd3ed1f16 (127.24.205.129:35259): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 84c9d416bd204b1c8c8faabbfb02b8a3: Network error: Client connection negotiation failed: client connection to 127.24.205.129:35259: connect: Connection refused (error 111)
I20260810 01:37:09.323189 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 696
I20260810 01:37:09.336835 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 32635
2026-08-10T01:37:09Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1389 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 01:37:09.363132 25398 mini_oidc.cc:152] Starting JWKS server
I20260810 01:37:09.365083 25398 webserver.cc:460] Webserver started at https://127.0.0.1:42489/ using document root <none> and password file <none>
I20260810 01:37:09.365231 25398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 01:37:09.365463 25398 webserver.cc:460] Webserver started at http://127.0.0.1:36345/ using document root <none> and password file <none>
2026-08-10T01:37:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:09Z Disabled control of system clock
I20260810 01:37:09.376423 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:33857
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:37137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:33857
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42489/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/testchainca.cert with env {}
W20260810 01:37:09.488638 980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:09.488870 980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:09.488907 980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:09.493415 980 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:09.493468 980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:09.493484 980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:09.493500 980 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:09.493515 980 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:37:09.493530 980 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:37:09.493544 980 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42489/jwks.json
I20260810 01:37:09.498617 980 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:33857
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:33857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42489/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:09.499480 980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:09.500437 980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:09.508782 988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:09.508852 987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:09.509008 990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:09.509023 980 server_base.cc:1034] running on GCE node
I20260810 01:37:09.509822 980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:09.510847 980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:09.512015 980 hybrid_clock.cc:648] HybridClock initialized: now 1786325829511987 us; error 39 us; skew 500 ppm
I20260810 01:37:09.513849 980 webserver.cc:460] Webserver started at http://127.24.205.190:38251/ using document root <none> and password file <none>
I20260810 01:37:09.514411 980 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:09.514473 980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:09.514714 980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:09.516772 980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "b40785b21fb647d9835f98192c995023"
format_stamp: "Formatted at 2026-08-10 01:37:09 on dist-test-slave-t3q3"
server_key: "d6ce2b3cba6029728860dbcc55758b3b"
server_key_iv: "b1ef6455cc000c411efffde21e104f59"
server_key_version: "encryptionkey@0"
I20260810 01:37:09.517351 980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "b40785b21fb647d9835f98192c995023"
format_stamp: "Formatted at 2026-08-10 01:37:09 on dist-test-slave-t3q3"
server_key: "d6ce2b3cba6029728860dbcc55758b3b"
server_key_iv: "b1ef6455cc000c411efffde21e104f59"
server_key_version: "encryptionkey@0"
I20260810 01:37:09.521103 980 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:37:09.523559 1000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:09.524827 980 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:09.524955 980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "b40785b21fb647d9835f98192c995023"
format_stamp: "Formatted at 2026-08-10 01:37:09 on dist-test-slave-t3q3"
server_key: "d6ce2b3cba6029728860dbcc55758b3b"
server_key_iv: "b1ef6455cc000c411efffde21e104f59"
server_key_version: "encryptionkey@0"
I20260810 01:37:09.525065 980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:09.554297 980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:09.554993 980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:09.555205 980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:09.562561 980 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:33857
I20260810 01:37:09.562638 1089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:33857 every 8 connection(s)
I20260810 01:37:09.563547 980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:09.566774 1090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:09.572217 1090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023: Bootstrap starting.
I20260810 01:37:09.572665 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 980
I20260810 01:37:09.572813 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:09.573102 25398 external_mini_cluster.cc:1428] Setting key fce40116904a0358a24af1e67f5fa111
I20260810 01:37:09.574841 1090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:09.575587 1090 log.cc:824] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:09.577721 1090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023: No bootstrap required, opened a new log
I20260810 01:37:09.582086 1090 raft_consensus.cc:348] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40785b21fb647d9835f98192c995023" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33857 } }
I20260810 01:37:09.582302 1090 raft_consensus.cc:374] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:09.582363 1090 raft_consensus.cc:729] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b40785b21fb647d9835f98192c995023, State: Initialized, Role: FOLLOWER
I20260810 01:37:09.582535 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.574445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57682 (local address 127.24.205.190:33857)
0810 01:37:09.575111 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:09.575126 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:09.575168 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:37:09.575840 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:09.575859 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:09.576327 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:09.576650 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:09.576981 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.577993 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.579233 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.579697 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.579815 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:09.580709 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:09.580714 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:09.580726 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:09.581089 (+ 363us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:09.581142 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:09.581171 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:09.581247 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:09.581432 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 01:37:09.581710 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":138,"threads_started":1}
I20260810 01:37:09.582832 1090 consensus_queue.cc:260] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40785b21fb647d9835f98192c995023" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33857 } }
I20260810 01:37:09.582994 1090 raft_consensus.cc:388] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:09.583076 1090 raft_consensus.cc:482] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:09.583207 1090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:09.584102 1090 raft_consensus.cc:504] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40785b21fb647d9835f98192c995023" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33857 } }
I20260810 01:37:09.584496 1090 leader_election.cc:302] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b40785b21fb647d9835f98192c995023; no voters:
I20260810 01:37:09.584857 1090 leader_election.cc:288] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:09.585295 1098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:09.585436 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:37:09.585565 1098 raft_consensus.cc:686] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [term 1 LEADER]: Becoming Leader. State: Replica: b40785b21fb647d9835f98192c995023, State: Running, Role: LEADER
I20260810 01:37:09.585903 1098 consensus_queue.cc:237] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40785b21fb647d9835f98192c995023" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33857 } }
I20260810 01:37:09.586139 1090 sys_catalog.cc:564] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:09.587756 1100 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b40785b21fb647d9835f98192c995023" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40785b21fb647d9835f98192c995023" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33857 } } }
I20260810 01:37:09.587738 1101 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b40785b21fb647d9835f98192c995023. Latest consensus state: current_term: 1 leader_uuid: "b40785b21fb647d9835f98192c995023" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40785b21fb647d9835f98192c995023" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33857 } } }
I20260810 01:37:09.587888 1100 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:09.587888 1101 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023 [sys.catalog]: This master's current role is: LEADER
W20260810 01:37:09.591096 1121 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:37:09.591233 1121 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:37:09.591320 1118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:09.592176 1118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:09.597254 1118 catalog_manager.cc:1347] Generated new cluster ID: e3b8ce914d44427db7575b82ff65fdfe
I20260810 01:37:09.597314 1118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:09.623175 1118 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:09.624208 1118 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:09.631624 1118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b40785b21fb647d9835f98192c995023: Generated new TSK 0
I20260810 01:37:09.632395 1118 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 01:37:09.663254 1134 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 01:37:09.663424 1134 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 01:37:09.663985 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.645582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.24.205.190:33857)
0810 01:37:09.645718 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:09.645723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:09.645917 (+ 194us) server_negotiation.cc:407] Connection header received
0810 01:37:09.646108 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:09.646111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:09.646176 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:09.646285 (+ 109us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:37:09.646520 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.647360 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.648261 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.648646 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.648752 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:09.649072 (+ 320us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:37:09.663597 (+ 14525us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42489/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 01:37:09.663851 (+ 254us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57696: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42489/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 01:37:09.664089 1094 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57696: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42489/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 01:37:09.665289 1133 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:09.645467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:33857 (local address 127.0.0.1:57696)
0810 01:37:09.645834 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:09.645848 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:09.645955 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:09.646302 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:09.646304 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:09.646311 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:37:09.646415 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:09.646420 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.647465 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.647467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:09.648153 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:09.648162 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.648768 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.648771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:09.648845 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:09.648889 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:37:09.663814 (+ 14925us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42489/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 01:37:09.663994 (+ 180us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.205.190:33857: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42489/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":116,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.24.205.190:33857: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42489/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 01:37:09.666064 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 980
2026-08-10T01:37:09Z chronyd exiting
I20260810 01:37:09.709082 25398 test_util.cc:175] -----------------------------------------------
I20260810 01:37:09.709198 25398 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786325801109519-25398-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (347 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 01:37:09.710335 25398 mini_oidc.cc:152] Starting JWKS server
I20260810 01:37:09.711258 25398 webserver.cc:460] Webserver started at https://127.0.0.1:44289/ using document root <none> and password file <none>
I20260810 01:37:09.711340 25398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 01:37:09.711601 25398 webserver.cc:460] Webserver started at http://127.0.0.1:40931/ using document root <none> and password file <none>
2026-08-10T01:37:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:09Z Disabled control of system clock
I20260810 01:37:09.722133 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34037
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:34037
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44289/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/testchainca.cert with env {}
W20260810 01:37:09.836359 1146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:09.836621 1146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:09.836660 1146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:09.840749 1146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:09.840802 1146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:09.840819 1146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:09.840837 1146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:09.840876 1146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:37:09.840909 1146 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:37:09.840934 1146 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44289/jwks.json
I20260810 01:37:09.846191 1146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:34037
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44289/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:09.847229 1146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:09.848309 1146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:09.856691 1158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:09.856792 1154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:09.856932 1146 server_base.cc:1034] running on GCE node
W20260810 01:37:09.857056 1153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:09.857635 1146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:09.858704 1146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:09.859871 1146 hybrid_clock.cc:648] HybridClock initialized: now 1786325829859845 us; error 38 us; skew 500 ppm
I20260810 01:37:09.861748 1146 webserver.cc:460] Webserver started at http://127.24.205.190:44561/ using document root <none> and password file <none>
I20260810 01:37:09.862337 1146 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:09.862401 1146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:09.862612 1146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:09.864759 1146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "0c6e16609aff44919ff87fc580671afc"
format_stamp: "Formatted at 2026-08-10 01:37:09 on dist-test-slave-t3q3"
server_key: "b780cd52e9df38ee77bd616dbff1fd27"
server_key_iv: "00f8141eb77cadb3e0a1baa6add6693d"
server_key_version: "encryptionkey@0"
I20260810 01:37:09.865348 1146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "0c6e16609aff44919ff87fc580671afc"
format_stamp: "Formatted at 2026-08-10 01:37:09 on dist-test-slave-t3q3"
server_key: "b780cd52e9df38ee77bd616dbff1fd27"
server_key_iv: "00f8141eb77cadb3e0a1baa6add6693d"
server_key_version: "encryptionkey@0"
I20260810 01:37:09.869197 1146 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 01:37:09.871621 1166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:09.872875 1146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:09.873034 1146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "0c6e16609aff44919ff87fc580671afc"
format_stamp: "Formatted at 2026-08-10 01:37:09 on dist-test-slave-t3q3"
server_key: "b780cd52e9df38ee77bd616dbff1fd27"
server_key_iv: "00f8141eb77cadb3e0a1baa6add6693d"
server_key_version: "encryptionkey@0"
I20260810 01:37:09.873157 1146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:09.888739 1146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:09.889443 1146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:09.889649 1146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:09.897204 1146 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:34037
I20260810 01:37:09.897207 1247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:34037 every 8 connection(s)
I20260810 01:37:09.898324 1146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:09.901736 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:09.907259 1248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc: Bootstrap starting.
I20260810 01:37:09.908378 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 1146
I20260810 01:37:09.908522 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:09.908826 25398 external_mini_cluster.cc:1428] Setting key 9daae778c3f512c45d974b4795dbd70d
I20260810 01:37:09.910241 1248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:09.911064 1248 log.cc:824] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:09.913321 1248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc: No bootstrap required, opened a new log
I20260810 01:37:09.917730 1248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6e16609aff44919ff87fc580671afc" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34037 } }
I20260810 01:37:09.917976 1248 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:09.918058 1248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6e16609aff44919ff87fc580671afc, State: Initialized, Role: FOLLOWER
I20260810 01:37:09.918241 1252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.909947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54138 (local address 127.24.205.190:34037)
0810 01:37:09.910592 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:09.910607 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:09.910643 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:37:09.911356 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:09.911375 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:09.911800 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:09.912189 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:09.912540 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.913606 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.914831 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.915315 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.915435 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:09.916320 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:09.916325 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:09.916338 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:09.916730 (+ 392us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:09.916785 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:09.916805 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:09.916885 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:09.917082 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 01:37:09.917390 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":146,"threads_started":1}
I20260810 01:37:09.918596 1248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6e16609aff44919ff87fc580671afc" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34037 } }
I20260810 01:37:09.918757 1248 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:09.918820 1248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:09.918915 1248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:09.919899 1248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6e16609aff44919ff87fc580671afc" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34037 } }
I20260810 01:37:09.920311 1248 leader_election.cc:302] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c6e16609aff44919ff87fc580671afc; no voters:
I20260810 01:37:09.920701 1248 leader_election.cc:288] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:09.920771 1256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:09.920984 1256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [term 1 LEADER]: Becoming Leader. State: Replica: 0c6e16609aff44919ff87fc580671afc, State: Running, Role: LEADER
I20260810 01:37:09.921358 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:37:09.921320 1256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6e16609aff44919ff87fc580671afc" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34037 } }
I20260810 01:37:09.922147 1248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:09.923146 1258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c6e16609aff44919ff87fc580671afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6e16609aff44919ff87fc580671afc" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34037 } } }
I20260810 01:37:09.923310 1258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:09.923606 1257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c6e16609aff44919ff87fc580671afc. Latest consensus state: current_term: 1 leader_uuid: "0c6e16609aff44919ff87fc580671afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6e16609aff44919ff87fc580671afc" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34037 } } }
I20260810 01:37:09.923717 1257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:09.923729 1267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:09.926945 1267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:09.932677 1267 catalog_manager.cc:1347] Generated new cluster ID: 1e1c3accdf3d4aa2abe3b73bcfb33621
I20260810 01:37:09.932754 1267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:09.942691 1267 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:09.943878 1267 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:09.951289 1267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c6e16609aff44919ff87fc580671afc: Generated new TSK 0
I20260810 01:37:09.951964 1267 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 01:37:09.977917 1296 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 01:37:09.978142 1296 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 01:37:09.978794 1252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:09.962830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54150 (local address 127.24.205.190:34037)
0810 01:37:09.962971 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:09.962976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:09.963134 (+ 158us) server_negotiation.cc:407] Connection header received
0810 01:37:09.963290 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:09.963294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:09.963351 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:09.963468 (+ 117us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:37:09.963687 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.964559 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.965401 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.965753 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.965856 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:09.966139 (+ 283us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:37:09.978362 (+ 12223us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44289/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 01:37:09.978646 (+ 284us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54150: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44289/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 01:37:09.978864 1252 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54150: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44289/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 01:37:09.978916 1294 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:09.962720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:34037 (local address 127.0.0.1:54150)
0810 01:37:09.963043 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:09.963056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:09.963151 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:09.963472 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:09.963474 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:09.963480 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:37:09.963579 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:09.963584 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.964665 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.964668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:09.965289 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:09.965297 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:09.965876 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:09.965879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:09.965943 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:09.965965 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:37:09.978589 (+ 12624us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44289/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 01:37:09.978734 (+ 145us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.205.190:34037: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44289/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":109,"threads_started":1}
I20260810 01:37:09.979377 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 1146
2026-08-10T01:37:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (318 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 01:37:10.028817 25398 mini_oidc.cc:152] Starting JWKS server
I20260810 01:37:10.029745 25398 webserver.cc:460] Webserver started at https://127.0.0.1:42817/ using document root <none> and password file <none>
I20260810 01:37:10.029888 25398 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 01:37:10.030181 25398 webserver.cc:460] Webserver started at http://127.0.0.1:42557/ using document root <none> and password file <none>
2026-08-10T01:37:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:10Z Disabled control of system clock
I20260810 01:37:10.040885 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:40251
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:40251
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42817/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 01:37:10.153205 1303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:10.153512 1303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:10.153590 1303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:10.157641 1303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:10.157727 1303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:10.157757 1303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:10.157797 1303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:10.157830 1303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:37:10.157867 1303 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:37:10.157895 1303 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42817/jwks.json
I20260810 01:37:10.162571 1303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:40251
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:40251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42817/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:10.163620 1303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:10.165019 1303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:10.173735 1310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:10.173709 1312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:10.173745 1315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:10.173890 1303 server_base.cc:1034] running on GCE node
I20260810 01:37:10.174634 1303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:10.175670 1303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:10.176857 1303 hybrid_clock.cc:648] HybridClock initialized: now 1786325830176840 us; error 34 us; skew 500 ppm
I20260810 01:37:10.178640 1303 webserver.cc:460] Webserver started at http://127.24.205.190:41279/ using document root <none> and password file <none>
I20260810 01:37:10.179204 1303 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:10.179297 1303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:10.179524 1303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:10.181558 1303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "6f11cf33d8b24416846c6b7849f2363a"
format_stamp: "Formatted at 2026-08-10 01:37:10 on dist-test-slave-t3q3"
server_key: "5501951d7557ef51d83bbae583c47390"
server_key_iv: "bf62d41f15fdab7b99b2257b740bc37b"
server_key_version: "encryptionkey@0"
I20260810 01:37:10.182150 1303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "6f11cf33d8b24416846c6b7849f2363a"
format_stamp: "Formatted at 2026-08-10 01:37:10 on dist-test-slave-t3q3"
server_key: "5501951d7557ef51d83bbae583c47390"
server_key_iv: "bf62d41f15fdab7b99b2257b740bc37b"
server_key_version: "encryptionkey@0"
I20260810 01:37:10.185806 1303 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260810 01:37:10.188238 1322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:10.189448 1303 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:10.189599 1303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "6f11cf33d8b24416846c6b7849f2363a"
format_stamp: "Formatted at 2026-08-10 01:37:10 on dist-test-slave-t3q3"
server_key: "5501951d7557ef51d83bbae583c47390"
server_key_iv: "bf62d41f15fdab7b99b2257b740bc37b"
server_key_version: "encryptionkey@0"
I20260810 01:37:10.189713 1303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:10.206640 1303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:10.207270 1303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:10.207460 1303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:10.214784 1406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:40251 every 8 connection(s)
I20260810 01:37:10.214785 1303 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:40251
I20260810 01:37:10.215770 1303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:10.217182 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 1303
I20260810 01:37:10.217330 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:10.217667 25398 external_mini_cluster.cc:1428] Setting key 7f2bbf375f7dc57bf21190cfa9ee59ba
I20260810 01:37:10.219689 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:10.225224 1407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a: Bootstrap starting.
I20260810 01:37:10.226963 1412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:10.219011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39502 (local address 127.24.205.190:40251)
0810 01:37:10.219677 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:10.219692 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:10.219728 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:37:10.220493 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:10.220513 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:10.220904 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:10.221250 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:10.221689 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.222663 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.223602 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.224137 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.224306 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:10.225237 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:10.225241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:10.225253 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:10.225696 (+ 443us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:10.225753 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:10.225774 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:10.225890 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:10.226028 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 01:37:10.226286 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":158,"threads_started":1}
I20260810 01:37:10.227566 1407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:10.228408 1407 log.cc:824] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:10.229802 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:37:10.230499 1407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a: No bootstrap required, opened a new log
I20260810 01:37:10.234033 1407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f11cf33d8b24416846c6b7849f2363a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40251 } }
I20260810 01:37:10.234243 1407 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:10.234330 1407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f11cf33d8b24416846c6b7849f2363a, State: Initialized, Role: FOLLOWER
I20260810 01:37:10.234787 1407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f11cf33d8b24416846c6b7849f2363a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40251 } }
I20260810 01:37:10.234935 1407 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:10.235011 1407 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:10.235107 1407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:10.236155 1407 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f11cf33d8b24416846c6b7849f2363a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40251 } }
I20260810 01:37:10.236531 1407 leader_election.cc:302] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f11cf33d8b24416846c6b7849f2363a; no voters:
I20260810 01:37:10.236867 1407 leader_election.cc:288] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:10.236994 1415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:10.237249 1415 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [term 1 LEADER]: Becoming Leader. State: Replica: 6f11cf33d8b24416846c6b7849f2363a, State: Running, Role: LEADER
I20260810 01:37:10.237584 1415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f11cf33d8b24416846c6b7849f2363a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40251 } }
I20260810 01:37:10.238168 1407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:10.239187 1418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f11cf33d8b24416846c6b7849f2363a. Latest consensus state: current_term: 1 leader_uuid: "6f11cf33d8b24416846c6b7849f2363a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f11cf33d8b24416846c6b7849f2363a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40251 } } }
I20260810 01:37:10.239339 1418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:10.239750 1428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:10.239944 1416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f11cf33d8b24416846c6b7849f2363a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f11cf33d8b24416846c6b7849f2363a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40251 } } }
I20260810 01:37:10.240087 1416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:10.242677 1428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:10.248390 1428 catalog_manager.cc:1347] Generated new cluster ID: 69845c3ad40c448cb101cafc0d92a293
I20260810 01:37:10.248457 1428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:10.260479 1428 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:10.261729 1428 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:10.272945 1428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f11cf33d8b24416846c6b7849f2363a: Generated new TSK 0
I20260810 01:37:10.273813 1428 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:37:10.287951 1412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:10.282772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.24.205.190:40251)
0810 01:37:10.282908 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:10.282913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:10.283126 (+ 213us) server_negotiation.cc:407] Connection header received
0810 01:37:10.283270 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:10.283273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:10.283329 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:10.283452 (+ 123us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:37:10.283665 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.284540 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.285410 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.285746 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.285852 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:10.286145 (+ 293us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:37:10.287590 (+ 1445us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 01:37:10.287821 (+ 231us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 01:37:10.288019 1412 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 01:37:10.289819 1449 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:10.282717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:40251 (local address 127.0.0.1:39516)
0810 01:37:10.283037 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:10.283050 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:10.283149 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:10.283457 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:10.283459 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:10.283465 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:37:10.283560 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:10.283565 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.284656 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.284659 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:10.285292 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:10.285300 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.285873 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.285876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:10.285943 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:10.285964 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:37:10.287757 (+ 1793us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 01:37:10.289638 (+ 1881us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.205.190:40251: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":1697,"thread_start_us":139,"threads_started":1}
I20260810 01:37:10.290128 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 1303
E20260810 01:37:10.319068 1453 webserver.cc:533] Webserver: sslize failed:
E20260810 01:37:10.319187 1453 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T01:37:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (322 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T01:37:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:10Z Disabled control of system clock
I20260810 01:37:10.361358 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:33897
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:42517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:33897
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/testchainca.cert with env {}
W20260810 01:37:10.475266 1461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:10.475567 1461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:10.475610 1461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:10.479736 1461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:10.479807 1461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:10.479823 1461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:10.479841 1461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:10.479856 1461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:37:10.479873 1461 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:37:10.479933 1461 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 01:37:10.485522 1461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:42517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:33897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:33897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:10.486703 1461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:10.487803 1461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:10.496994 1470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:10.497083 1472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:10.497249 1461 server_base.cc:1034] running on GCE node
W20260810 01:37:10.496969 1467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:10.498065 1461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:10.499193 1461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:10.500356 1461 hybrid_clock.cc:648] HybridClock initialized: now 1786325830500337 us; error 32 us; skew 500 ppm
I20260810 01:37:10.502334 1461 webserver.cc:460] Webserver started at http://127.24.205.190:41441/ using document root <none> and password file <none>
I20260810 01:37:10.502964 1461 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:10.503031 1461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:10.503265 1461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:10.505488 1461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "37558ecbfe374990ad8af0b14677ec52"
format_stamp: "Formatted at 2026-08-10 01:37:10 on dist-test-slave-t3q3"
server_key: "e77c2cc360eafc33c41ecf1accbaa7fa"
server_key_iv: "d6d436a07fc3a3bfceb991491e8c7fb1"
server_key_version: "encryptionkey@0"
I20260810 01:37:10.506182 1461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "37558ecbfe374990ad8af0b14677ec52"
format_stamp: "Formatted at 2026-08-10 01:37:10 on dist-test-slave-t3q3"
server_key: "e77c2cc360eafc33c41ecf1accbaa7fa"
server_key_iv: "d6d436a07fc3a3bfceb991491e8c7fb1"
server_key_version: "encryptionkey@0"
I20260810 01:37:10.510133 1461 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:10.512861 1481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:10.514202 1461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:37:10.514343 1461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "37558ecbfe374990ad8af0b14677ec52"
format_stamp: "Formatted at 2026-08-10 01:37:10 on dist-test-slave-t3q3"
server_key: "e77c2cc360eafc33c41ecf1accbaa7fa"
server_key_iv: "d6d436a07fc3a3bfceb991491e8c7fb1"
server_key_version: "encryptionkey@0"
I20260810 01:37:10.514460 1461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:10.534700 1461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:10.535488 1461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:10.535705 1461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:10.543103 1461 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:33897
I20260810 01:37:10.543129 1560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:33897 every 8 connection(s)
I20260810 01:37:10.544171 1461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:10.547150 1565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:10.547931 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 1461
I20260810 01:37:10.548095 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:10.548429 25398 external_mini_cluster.cc:1428] Setting key cd5606e94ac0d619ee34e530e6908dd0
I20260810 01:37:10.553972 1565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52: Bootstrap starting.
I20260810 01:37:10.556841 1565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:10.557761 1565 log.cc:824] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:10.558583 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:10.549957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55864 (local address 127.24.205.190:33897)
0810 01:37:10.550693 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:10.550710 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:10.550749 (+ 39us) server_negotiation.cc:407] Connection header received
0810 01:37:10.551411 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:10.551429 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:10.551898 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:10.552280 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:10.552648 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.553644 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.554866 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.555361 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.555483 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:10.556527 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:10.556533 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:10.556547 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:10.556999 (+ 452us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:10.557059 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:10.557082 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:10.557178 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:10.557336 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 01:37:10.557644 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":151,"threads_started":1}
I20260810 01:37:10.560134 1565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52: No bootstrap required, opened a new log
I20260810 01:37:10.561723 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:37:10.564772 1565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37558ecbfe374990ad8af0b14677ec52" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33897 } }
I20260810 01:37:10.565006 1565 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:10.565043 1565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37558ecbfe374990ad8af0b14677ec52, State: Initialized, Role: FOLLOWER
I20260810 01:37:10.565423 1565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37558ecbfe374990ad8af0b14677ec52" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33897 } }
I20260810 01:37:10.565541 1565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:10.565587 1565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:10.565661 1565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:10.566680 1565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37558ecbfe374990ad8af0b14677ec52" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33897 } }
I20260810 01:37:10.566991 1565 leader_election.cc:302] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37558ecbfe374990ad8af0b14677ec52; no voters:
I20260810 01:37:10.567267 1565 leader_election.cc:288] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:10.567435 1575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:10.567688 1575 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [term 1 LEADER]: Becoming Leader. State: Replica: 37558ecbfe374990ad8af0b14677ec52, State: Running, Role: LEADER
I20260810 01:37:10.568022 1575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37558ecbfe374990ad8af0b14677ec52" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33897 } }
I20260810 01:37:10.568634 1565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:10.569921 1577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37558ecbfe374990ad8af0b14677ec52. Latest consensus state: current_term: 1 leader_uuid: "37558ecbfe374990ad8af0b14677ec52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37558ecbfe374990ad8af0b14677ec52" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33897 } } }
I20260810 01:37:10.570075 1577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:10.570470 1584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:10.570416 1576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37558ecbfe374990ad8af0b14677ec52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37558ecbfe374990ad8af0b14677ec52" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 33897 } } }
I20260810 01:37:10.570591 1576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:10.573729 1584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:10.579666 1584 catalog_manager.cc:1347] Generated new cluster ID: 1cd4c98e90f94dc180c0ec4bb204b342
I20260810 01:37:10.579751 1584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:10.605113 1584 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:10.606454 1584 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:10.613693 1584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37558ecbfe374990ad8af0b14677ec52: Generated new TSK 0
I20260810 01:37:10.614512 1584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:37:10.790092 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:10.635398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55876 (local address 127.24.205.190:33897)
0810 01:37:10.635540 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:10.635545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:10.635702 (+ 157us) server_negotiation.cc:407] Connection header received
0810 01:37:10.635841 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:10.635844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:10.635902 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:10.636021 (+ 119us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:37:10.636311 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.637155 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.638028 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.638397 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.638504 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:10.638871 (+ 367us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:37:10.789628 (+150757us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 01:37:10.789949 (+ 321us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55876: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 01:37:10.790179 1569 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55876: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 01:37:10.790364 1603 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:10.635302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:33897 (local address 127.0.0.1:55876)
0810 01:37:10.635613 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:10.635626 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:10.635728 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:10.636027 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:10.636030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:10.636036 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:37:10.636194 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:10.636201 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.637281 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.637283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:10.637906 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:10.637913 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:10.638538 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:10.638545 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:10.638645 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:10.638674 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:37:10.789910 (+151236us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 01:37:10.790106 (+ 196us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.205.190:33897: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":122,"threads_started":1}
I20260810 01:37:10.791399 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 1461
2026-08-10T01:37:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (468 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (133 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (129 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:11 dist-test-slave-t3q3 krb5kdc[1620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:11 dist-test-slave-t3q3 krb5kdc[1620](info): set up 2 sockets
Aug 10 01:37:11 dist-test-slave-t3q3 krb5kdc[1620](info): commencing operation
krb5kdc: starting...
W20260810 01:37:12.322921 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:12 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:12.458709 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42835
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:42835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:12.571674 1642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:12.572003 1642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:12.572109 1642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:12.576225 1642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:12.576318 1642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:12.576355 1642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:12.576407 1642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:12.576445 1642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:12.582188 1642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:42835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:12.583312 1642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:12.584420 1642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:12.592892 1654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:12.592988 1652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:12.592900 1657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:12.593252 1642 server_base.cc:1034] running on GCE node
I20260810 01:37:12.593897 1642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:12.595000 1642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:12.596143 1642 hybrid_clock.cc:648] HybridClock initialized: now 1786325832596122 us; error 31 us; skew 500 ppm
Aug 10 01:37:12 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325832, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:12.602384 1642 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:12.603340 1642 webserver.cc:460] Webserver started at http://127.24.205.190:46465/ using document root <none> and password file <none>
I20260810 01:37:12.603994 1642 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:12.604115 1642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:12.604368 1642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:12.606473 1642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "b219fb351aea418c9bacde6076b09f5b"
format_stamp: "Formatted at 2026-08-10 01:37:12 on dist-test-slave-t3q3"
server_key: "e15e2d82b3739b64a391dadf99cf905b"
server_key_iv: "e5315f9246be744fb2ec177b5c665603"
server_key_version: "encryptionkey@0"
I20260810 01:37:12.607062 1642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "b219fb351aea418c9bacde6076b09f5b"
format_stamp: "Formatted at 2026-08-10 01:37:12 on dist-test-slave-t3q3"
server_key: "e15e2d82b3739b64a391dadf99cf905b"
server_key_iv: "e5315f9246be744fb2ec177b5c665603"
server_key_version: "encryptionkey@0"
I20260810 01:37:12.610877 1642 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 01:37:12.613412 1672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:12.614739 1642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:12.614842 1642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "b219fb351aea418c9bacde6076b09f5b"
format_stamp: "Formatted at 2026-08-10 01:37:12 on dist-test-slave-t3q3"
server_key: "e15e2d82b3739b64a391dadf99cf905b"
server_key_iv: "e5315f9246be744fb2ec177b5c665603"
server_key_version: "encryptionkey@0"
I20260810 01:37:12.614974 1642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:12.662262 1642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:12.666759 1642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:12.666997 1642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:12.675906 1744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:42835 every 8 connection(s)
I20260810 01:37:12.675923 1642 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:42835
I20260810 01:37:12.677428 1642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:12.681088 1745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:12.686039 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 1642
I20260810 01:37:12.686220 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:12.686512 25398 external_mini_cluster.cc:1428] Setting key cb7407a89959b14e89bbf0f5b3e5ba71
I20260810 01:37:12.688747 1745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b: Bootstrap starting.
I20260810 01:37:12.692260 1745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:12.693353 1745 log.cc:824] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:12.695919 1745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b: No bootstrap required, opened a new log
Aug 10 01:37:12 dist-test-slave-t3q3 krb5kdc[1620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:12.701207 1745 raft_consensus.cc:348] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b219fb351aea418c9bacde6076b09f5b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42835 } }
I20260810 01:37:12.701546 1745 raft_consensus.cc:374] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:12.701618 1745 raft_consensus.cc:729] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b219fb351aea418c9bacde6076b09f5b, State: Initialized, Role: FOLLOWER
I20260810 01:37:12.702196 1745 consensus_queue.cc:260] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b219fb351aea418c9bacde6076b09f5b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42835 } }
I20260810 01:37:12.702390 1745 raft_consensus.cc:388] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:12.702476 1745 raft_consensus.cc:482] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:12.702603 1745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:12.703974 1753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:12.687949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44352 (local address 127.24.205.190:42835)
0810 01:37:12.688462 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:12.688481 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:12.688527 (+ 46us) server_negotiation.cc:407] Connection header received
0810 01:37:12.689305 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:12.689325 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:12.689681 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:12.690032 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:12.691013 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:12.692001 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:12.693462 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:12.694268 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:12.694418 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:12.697701 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:12.697707 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:12.697721 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:12.697750 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:12.700178 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:12.700738 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:12.700744 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:12.700752 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:12.700900 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:12.701258 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:12.701262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:12.701263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:12.701854 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:12.702095 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:12.702421 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 01:37:12.702910 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":169,"threads_started":1}
I20260810 01:37:12.704092 1745 raft_consensus.cc:504] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b219fb351aea418c9bacde6076b09f5b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42835 } }
I20260810 01:37:12.704537 1745 leader_election.cc:302] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b219fb351aea418c9bacde6076b09f5b; no voters:
I20260810 01:37:12.704949 1745 leader_election.cc:288] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:12.705087 1757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:12.705349 1757 raft_consensus.cc:686] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [term 1 LEADER]: Becoming Leader. State: Replica: b219fb351aea418c9bacde6076b09f5b, State: Running, Role: LEADER
I20260810 01:37:12.705701 1757 consensus_queue.cc:237] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b219fb351aea418c9bacde6076b09f5b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42835 } }
I20260810 01:37:12.706496 1745 sys_catalog.cc:564] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:12.707038 1757 sys_catalog.cc:455] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b219fb351aea418c9bacde6076b09f5b. Latest consensus state: current_term: 1 leader_uuid: "b219fb351aea418c9bacde6076b09f5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b219fb351aea418c9bacde6076b09f5b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42835 } } }
I20260810 01:37:12.707245 1757 sys_catalog.cc:458] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:12.707530 1758 sys_catalog.cc:455] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b219fb351aea418c9bacde6076b09f5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b219fb351aea418c9bacde6076b09f5b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42835 } } }
I20260810 01:37:12.707621 1758 sys_catalog.cc:458] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:12.707880 1767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:12.711709 1767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:12.718014 1767 catalog_manager.cc:1347] Generated new cluster ID: 771746a74a4447c4b4c52107d41c733a
I20260810 01:37:12.718091 1767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:12.727535 1767 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:12.729236 1767 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:12.739061 1767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b219fb351aea418c9bacde6076b09f5b: Generated new TSK 0
I20260810 01:37:12.739964 1767 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:37:12.775270 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42835
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:12.889818 1796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:12.890103 1796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:12.890187 1796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:12.894382 1796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:12.894462 1796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:12.894550 1796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:12.899554 1796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:12.900687 1796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:12.901755 1796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:12.911708 1803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:12.911792 1805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:12.911759 1802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:12.911904 1796 server_base.cc:1034] running on GCE node
I20260810 01:37:12.912392 1796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:12.912951 1796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:12.914153 1796 hybrid_clock.cc:648] HybridClock initialized: now 1786325832914128 us; error 51 us; skew 500 ppm
Aug 10 01:37:12 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325832, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:12.916937 1796 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:37:12.917791 1796 webserver.cc:460] Webserver started at http://127.24.205.129:37613/ using document root <none> and password file <none>
I20260810 01:37:12.918426 1796 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:12.918517 1796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:12.918774 1796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:12.920991 1796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "1992f4e24c014edfb65b30261ff7d8f4"
format_stamp: "Formatted at 2026-08-10 01:37:12 on dist-test-slave-t3q3"
server_key: "b76411a8bf0559c6d13e2a5cc7cba2f9"
server_key_iv: "d3aac6a7f15148bac9e1da3f611ecc5e"
server_key_version: "encryptionkey@0"
I20260810 01:37:12.921615 1796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "1992f4e24c014edfb65b30261ff7d8f4"
format_stamp: "Formatted at 2026-08-10 01:37:12 on dist-test-slave-t3q3"
server_key: "b76411a8bf0559c6d13e2a5cc7cba2f9"
server_key_iv: "d3aac6a7f15148bac9e1da3f611ecc5e"
server_key_version: "encryptionkey@0"
I20260810 01:37:12.925320 1796 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:12.927753 1815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:12.929011 1796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:12.929172 1796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "1992f4e24c014edfb65b30261ff7d8f4"
format_stamp: "Formatted at 2026-08-10 01:37:12 on dist-test-slave-t3q3"
server_key: "b76411a8bf0559c6d13e2a5cc7cba2f9"
server_key_iv: "d3aac6a7f15148bac9e1da3f611ecc5e"
server_key_version: "encryptionkey@0"
I20260810 01:37:12.929286 1796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:12.947888 1796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:12.951022 1796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:12.951247 1796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:12.951867 1796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:12.952801 1796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:12.952877 1796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:12.952988 1796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:12.953037 1796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:12.962283 1796 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:36383
I20260810 01:37:12.962306 1978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:36383 every 8 connection(s)
I20260810 01:37:12.963253 1796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
Aug 10 01:37:12 dist-test-slave-t3q3 krb5kdc[1620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325832, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:12.972872 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 1796
I20260810 01:37:12.973030 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:12.973345 25398 external_mini_cluster.cc:1428] Setting key 9d4e3b82952f73ecfb140076ede188d3
I20260810 01:37:12.977126 1753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:12.965191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:56339 (local address 127.24.205.190:42835)
0810 01:37:12.965330 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:12.965334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:12.966178 (+ 844us) server_negotiation.cc:407] Connection header received
0810 01:37:12.967517 (+ 1339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:12.967520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:12.967567 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:12.967644 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:12.968895 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:12.969450 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:12.970559 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:12.970795 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:12.970878 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:12.973417 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:12.973441 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:12.973446 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:12.973475 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:12.974965 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:12.975496 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:12.975500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:12.975502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:12.975589 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:12.975945 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:12.975949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:12.975951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:12.976215 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:12.976327 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:12.976828 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 01:37:12.976957 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:37:12.977926 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:12.965550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42835 (local address 127.24.205.129:56339)
0810 01:37:12.965987 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:12.966030 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:12.967314 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:12.967814 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:12.967821 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:12.968267 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:12.968752 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:12.968765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:12.969564 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:12.969566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:12.970446 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:12.970455 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:12.970929 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:12.970931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:12.971071 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:12.971612 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:12.971628 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:12.973246 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:12.975102 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:12.975107 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:12.975122 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:12.975387 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:12.975694 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:12.975697 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:12.975699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:12.975843 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:12.976326 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:12.976334 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:12.976580 (+ 246us) client_negotiation.cc:769] Sending connection context
0810 01:37:12.976782 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 01:37:12.977101 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":118,"threads_started":1}
I20260810 01:37:12.979193 1979 heartbeater.cc:347] Connected to a master server at 127.24.205.190:42835
I20260810 01:37:12.979449 1979 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:12.979940 1979 heartbeater.cc:511] Master 127.24.205.190:42835 requested a full tablet report, sending...
I20260810 01:37:12.981577 1693 ts_manager.cc:194] Registered new tserver with Master: 1992f4e24c014edfb65b30261ff7d8f4 (127.24.205.129:36383)
I20260810 01:37:12.982740 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:56339
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:37:13.003260 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42835
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:13.121073 1990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:13.121389 1990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:13.121486 1990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:13.125607 1990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:13.125692 1990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:13.125783 1990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:13.131562 1990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:13.132717 1990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:13.133824 1990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:13.143865 1997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:13.143901 1998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:13.143929 2000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:13.144083 1990 server_base.cc:1034] running on GCE node
I20260810 01:37:13.144621 1990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:13.145269 1990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:13.146469 1990 hybrid_clock.cc:648] HybridClock initialized: now 1786325833146456 us; error 26 us; skew 500 ppm
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.149348 1990 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:37:13.150297 1990 webserver.cc:460] Webserver started at http://127.24.205.130:36295/ using document root <none> and password file <none>
I20260810 01:37:13.150864 1990 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:13.150959 1990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:13.151207 1990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:13.153317 1990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "c121b0fd41bf470fac3d78d28932bb6f"
format_stamp: "Formatted at 2026-08-10 01:37:13 on dist-test-slave-t3q3"
server_key: "7f18d9c15915227842f1a6245021367c"
server_key_iv: "7b1059a36be6392e77e3891bd1cd041d"
server_key_version: "encryptionkey@0"
I20260810 01:37:13.153900 1990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "c121b0fd41bf470fac3d78d28932bb6f"
format_stamp: "Formatted at 2026-08-10 01:37:13 on dist-test-slave-t3q3"
server_key: "7f18d9c15915227842f1a6245021367c"
server_key_iv: "7b1059a36be6392e77e3891bd1cd041d"
server_key_version: "encryptionkey@0"
I20260810 01:37:13.157613 1990 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:37:13.160017 2009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:13.161314 1990 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:13.161463 1990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "c121b0fd41bf470fac3d78d28932bb6f"
format_stamp: "Formatted at 2026-08-10 01:37:13 on dist-test-slave-t3q3"
server_key: "7f18d9c15915227842f1a6245021367c"
server_key_iv: "7b1059a36be6392e77e3891bd1cd041d"
server_key_version: "encryptionkey@0"
I20260810 01:37:13.161576 1990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:13.211802 1990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:13.214825 1990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:13.215039 1990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:13.215641 1990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:13.216552 1990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:13.216622 1990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:13.216696 1990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:13.216747 1990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:13.225965 1990 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:44669
I20260810 01:37:13.225992 2182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:44669 every 8 connection(s)
I20260810 01:37:13.226866 1990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:13.231467 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 1990
I20260810 01:37:13.231619 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:13.231942 25398 external_mini_cluster.cc:1428] Setting key 5532f3eb733f085268db8c0e7a0b1c56
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:13.242236 1753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:13.228777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:53147 (local address 127.24.205.190:42835)
0810 01:37:13.228930 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.228935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.229876 (+ 941us) server_negotiation.cc:407] Connection header received
0810 01:37:13.231253 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.231259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.231325 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.231433 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.233038 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.233673 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.234849 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.235251 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.235376 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:13.237985 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:13.237991 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:13.237997 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:13.238032 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:13.239739 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.240488 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.240491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.240492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.240574 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.241020 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.241022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.241024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.241228 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:13.241307 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:13.241985 (+ 678us) server_negotiation.cc:299] Negotiation successful
0810 01:37:13.242094 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:37:13.243487 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:13.229240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42835 (local address 127.24.205.130:53147)
0810 01:37:13.229712 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:13.229759 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:13.231034 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:13.231667 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:13.231680 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:13.232159 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:13.232885 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:13.232904 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.233797 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.233800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:13.234712 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:13.234721 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.235408 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.235410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:13.235560 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:13.236204 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:13.236221 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:13.237808 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:13.239858 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:13.239865 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:13.239886 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:13.240373 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:13.240682 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:13.240688 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:13.240692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:13.240900 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:13.241344 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:13.241354 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:13.241708 (+ 354us) client_negotiation.cc:769] Sending connection context
0810 01:37:13.241936 (+ 228us) client_negotiation.cc:240] Negotiation successful
0810 01:37:13.242321 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:37:13.244807 2183 heartbeater.cc:347] Connected to a master server at 127.24.205.190:42835
I20260810 01:37:13.245078 2183 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:13.245739 2183 heartbeater.cc:511] Master 127.24.205.190:42835 requested a full tablet report, sending...
I20260810 01:37:13.246912 1693 ts_manager.cc:194] Registered new tserver with Master: c121b0fd41bf470fac3d78d28932bb6f (127.24.205.130:44669)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:37:13.247635 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:53147
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:37:13.263811 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42835
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:13.378708 2189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:13.378948 2189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:13.378989 2189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:13.383121 2189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:13.383184 2189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:13.383242 2189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:13.388700 2189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:42835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:13.389674 2189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:13.390643 2189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:13.400301 2197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:13.400274 2195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:13.400280 2199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:13.400753 2189 server_base.cc:1034] running on GCE node
I20260810 01:37:13.401154 2189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:13.401799 2189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:13.402990 2189 hybrid_clock.cc:648] HybridClock initialized: now 1786325833402960 us; error 42 us; skew 500 ppm
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.405800 2189 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:37:13.406599 2189 webserver.cc:460] Webserver started at http://127.24.205.131:36865/ using document root <none> and password file <none>
I20260810 01:37:13.407207 2189 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:13.407274 2189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:13.407440 2189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:13.409518 2189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "549de39dce5e41969c91853d39ed0166"
format_stamp: "Formatted at 2026-08-10 01:37:13 on dist-test-slave-t3q3"
server_key: "4796cb131a5e22b8ede44a3d12e1b957"
server_key_iv: "e6c8c58b49bfbbbe1ff1a87813d1f475"
server_key_version: "encryptionkey@0"
I20260810 01:37:13.410043 2189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "549de39dce5e41969c91853d39ed0166"
format_stamp: "Formatted at 2026-08-10 01:37:13 on dist-test-slave-t3q3"
server_key: "4796cb131a5e22b8ede44a3d12e1b957"
server_key_iv: "e6c8c58b49bfbbbe1ff1a87813d1f475"
server_key_version: "encryptionkey@0"
I20260810 01:37:13.413691 2189 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:37:13.416031 2210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:13.417300 2189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:13.417405 2189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "549de39dce5e41969c91853d39ed0166"
format_stamp: "Formatted at 2026-08-10 01:37:13 on dist-test-slave-t3q3"
server_key: "4796cb131a5e22b8ede44a3d12e1b957"
server_key_iv: "e6c8c58b49bfbbbe1ff1a87813d1f475"
server_key_version: "encryptionkey@0"
I20260810 01:37:13.417486 2189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:13.437583 2189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:13.440433 2189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:13.440582 2189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:13.441084 2189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:13.441850 2189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:13.441897 2189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:13.441937 2189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:13.441956 2189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:13.450690 2189 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:39557
I20260810 01:37:13.450726 2393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:39557 every 8 connection(s)
I20260810 01:37:13.451583 2189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:13.461344 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 2189
I20260810 01:37:13.461503 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:13.461895 25398 external_mini_cluster.cc:1428] Setting key 6dbce13930740892c7ce601738cb937d
I20260810 01:37:13.465152 1753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:13.453368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:33895 (local address 127.24.205.190:42835)
0810 01:37:13.453505 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.453509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.454341 (+ 832us) server_negotiation.cc:407] Connection header received
0810 01:37:13.455680 (+ 1339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.455683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.455730 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.455805 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.456981 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.457519 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.458625 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.458845 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.458924 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:13.461376 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:13.461379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:13.461382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:13.461414 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:13.463002 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.463520 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.463523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.463525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.463611 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.464128 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.464131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.464133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.464328 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:13.464410 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:13.464938 (+ 528us) server_negotiation.cc:299] Negotiation successful
0810 01:37:13.465037 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:37:13.466074 2400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:13.453742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42835 (local address 127.24.205.131:33895)
0810 01:37:13.454183 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:13.454225 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:13.455474 (+ 1249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:13.455970 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:13.455976 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:13.456357 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:13.456847 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:13.456861 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.457631 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.457633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:13.458513 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:13.458522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.458974 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.458976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:13.459113 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:13.459746 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:13.459762 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:13.461207 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:13.463127 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:13.463133 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:13.463147 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:13.463409 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:13.463718 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:13.463721 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:13.463723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:13.463914 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:13.464413 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:13.464418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:13.464694 (+ 276us) client_negotiation.cc:769] Sending connection context
0810 01:37:13.464893 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 01:37:13.465141 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":122,"threads_started":1}
I20260810 01:37:13.467190 2396 heartbeater.cc:347] Connected to a master server at 127.24.205.190:42835
I20260810 01:37:13.467422 2396 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:13.467892 2396 heartbeater.cc:511] Master 127.24.205.190:42835 requested a full tablet report, sending...
I20260810 01:37:13.468974 1693 ts_manager.cc:194] Registered new tserver with Master: 549de39dce5e41969c91853d39ed0166 (127.24.205.131:39557)
I20260810 01:37:13.469583 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:33895
I20260810 01:37:13.475657 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/test-admin.keytab.
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.493232 25398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 01:37:13.496002 2405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:13.494632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34308 (local address 127.24.205.129:36383)
0810 01:37:13.494937 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.494952 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.494976 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:37:13.495033 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.495038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.495223 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.495346 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.495813 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34308: BlockingRecv error: recv got EOF from 127.0.0.1:34308 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":113,"threads_started":1}
W20260810 01:37:13.496157 25398 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc' of type FILE
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.497277 25398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.498322 25398 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:37:13.507974 2405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:13.499241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34312 (local address 127.24.205.129:36383)
0810 01:37:13.499379 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.499383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.499417 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:37:13.499534 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.499536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.499577 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.499645 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.500214 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.500967 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.501768 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.502233 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.502318 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:13.504605 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:13.504615 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:13.504627 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:13.504650 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:13.506211 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.506629 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.506634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.506635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.506729 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.506977 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.506979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.506980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.507245 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:13.507464 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:13.507624 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 01:37:13.507813 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 01:37:13.511907 2405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:13.510973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34326 (local address 127.24.205.129:36383)
0810 01:37:13.511157 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.511160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.511208 (+ 48us) server_negotiation.cc:407] Connection header received
0810 01:37:13.511320 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.511323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.511361 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.511425 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.511817 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34326: BlockingRecv error: recv got EOF from 127.0.0.1:34326 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
W20260810 01:37:13.512270 25398 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc)
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.513391 25398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.514304 25398 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:37:13.523391 2405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:13.515125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34338 (local address 127.24.205.129:36383)
0810 01:37:13.515248 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.515252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.515349 (+ 97us) server_negotiation.cc:407] Connection header received
0810 01:37:13.515493 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.515498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.515538 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.515619 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.516231 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.516738 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.517544 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.517778 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.517886 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:13.520275 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:13.520278 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:13.520280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:13.520301 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:13.521733 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.522182 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.522185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.522187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.522306 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.522592 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.522596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.522598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.522761 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:13.522912 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:13.523130 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 01:37:13.523237 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 01:37:13.526005 2405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:13.525057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34344 (local address 127.24.205.129:36383)
0810 01:37:13.525183 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.525186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.525221 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:37:13.525329 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.525331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.525364 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.525427 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.525922 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34344: BlockingRecv error: recv got EOF from 127.0.0.1:34344 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 01:37:13.526121 25398 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786325801109519-25398-0/krb5kdc/krb5cc' of type FILE
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.527107 25398 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:13.528003 25398 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[1620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:37:13.536127 2405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:13.528821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34350 (local address 127.24.205.129:36383)
0810 01:37:13.528950 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:13.528953 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:13.528966 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:13.529072 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:13.529074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:13.529107 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:13.529174 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:13.529629 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.530103 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.530849 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:13.531050 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:13.531125 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:13.533401 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:13.533404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:13.533406 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:13.533426 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:13.534698 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.535063 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.535065 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.535066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.535136 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:13.535365 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:13.535367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:13.535368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:13.535509 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:13.535617 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:13.535796 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 01:37:13.535913 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:37:13.537114 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 1796
I20260810 01:37:13.549603 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 1990
I20260810 01:37:13.560436 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 2189
I20260810 01:37:13.580856 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 1642
2026-08-10T01:37:13Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2525 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[2428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[2428](info): set up 2 sockets
Aug 10 01:37:13 dist-test-slave-t3q3 krb5kdc[2428](info): commencing operation
krb5kdc: starting...
W20260810 01:37:14.847632 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:14 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:14Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab.
Entry for principal oryx/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab.
I20260810 01:37:14.983067 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41855
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab
--principal=oryx/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:15.097916 2449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:15.098294 2449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:15.098366 2449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:15.102450 2449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:15.102541 2449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:15.102579 2449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:15.102618 2449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:15.102649 2449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:15.108278 2449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab
--principal=oryx/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:15.109422 2449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:15.110492 2449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:15.119762 2460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:15.119773 2464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:15.119768 2462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:15.120198 2449 server_base.cc:1034] running on GCE node
I20260810 01:37:15.120864 2449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:15.122028 2449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:15.123236 2449 hybrid_clock.cc:648] HybridClock initialized: now 1786325835123222 us; error 29 us; skew 500 ppm
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:15.126164 2449 init.cc:377] Logged in from keytab as oryx/127.24.205.190@KRBTEST.COM (short username oryx)
I20260810 01:37:15.126998 2449 webserver.cc:460] Webserver started at http://127.24.205.190:41431/ using document root <none> and password file <none>
I20260810 01:37:15.127529 2449 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:15.127588 2449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:15.127748 2449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:15.129884 2449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "97f6d350e4ba43698a548322594c6019"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "fc33dbf6a6dda8496ec9449035fc77db"
server_key_iv: "b0fa8a6c2258c7a911d1526f2341e55e"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.130430 2449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "97f6d350e4ba43698a548322594c6019"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "fc33dbf6a6dda8496ec9449035fc77db"
server_key_iv: "b0fa8a6c2258c7a911d1526f2341e55e"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.134271 2449 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 01:37:15.136749 2473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.138000 2449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:15.138130 2449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "97f6d350e4ba43698a548322594c6019"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "fc33dbf6a6dda8496ec9449035fc77db"
server_key_iv: "b0fa8a6c2258c7a911d1526f2341e55e"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.138238 2449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:15.151068 2449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:15.154630 2449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:15.154862 2449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:15.163059 2449 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:41855
I20260810 01:37:15.163344 2556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:41855 every 8 connection(s)
I20260810 01:37:15.164211 2449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:15.166993 2557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:15.170481 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 2449
I20260810 01:37:15.170634 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:15.170938 25398 external_mini_cluster.cc:1428] Setting key d619f1dc8cf7826344e36eba1fd65df1
I20260810 01:37:15.172860 2557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: Bootstrap starting.
I20260810 01:37:15.175307 2557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:15.176048 2557 log.cc:824] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:15.178305 2557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: No bootstrap required, opened a new log
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:15.182071 2557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } }
I20260810 01:37:15.182317 2557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:15.182401 2557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f6d350e4ba43698a548322594c6019, State: Initialized, Role: FOLLOWER
I20260810 01:37:15.182852 2557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } }
I20260810 01:37:15.183017 2557 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:15.183107 2557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:15.183234 2557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:15.184216 2557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } }
I20260810 01:37:15.184615 2557 leader_election.cc:302] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97f6d350e4ba43698a548322594c6019; no voters:
I20260810 01:37:15.184998 2557 leader_election.cc:288] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:15.185058 2566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:15.185274 2566 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 1 LEADER]: Becoming Leader. State: Replica: 97f6d350e4ba43698a548322594c6019, State: Running, Role: LEADER
I20260810 01:37:15.185526 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:15.172353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58232 (local address 127.24.205.190:41855)
0810 01:37:15.172751 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:15.172768 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:15.172803 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:37:15.173475 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:15.173493 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:15.173805 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:15.174068 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:15.174982 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.176033 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.177141 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.177589 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.177713 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:15.180566 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:15.180571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:15.180583 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:15.180608 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:15.182338 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.182910 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.182914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.182918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.183062 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.183425 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.183428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.183430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.183808 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:15.184024 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:15.184323 (+ 299us) server_negotiation.cc:299] Negotiation successful
0810 01:37:15.184619 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":129,"threads_started":1}
I20260810 01:37:15.185660 2566 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } }
I20260810 01:37:15.186358 2557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:15.188827 2570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97f6d350e4ba43698a548322594c6019. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } }
I20260810 01:37:15.189656 2570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:15.189133 2573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } }
I20260810 01:37:15.190395 2573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
W20260810 01:37:15.191516 2586 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:37:15.191599 2586 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:37:15.191685 2587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:15.192478 2587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:15.197530 2587 catalog_manager.cc:1347] Generated new cluster ID: 506ea438ae0844cbb5c7e9b10d96c4c0
I20260810 01:37:15.197592 2587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:15.212179 2587 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:15.213383 2587 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:15.233494 2587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: Generated new TSK 0
I20260810 01:37:15.234386 2587 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab.
Entry for principal oryx/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab.
I20260810 01:37:15.266687 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41855
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab
--principal=oryx/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:15.381412 2594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:15.381693 2594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:15.381773 2594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:15.385720 2594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:15.385793 2594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:15.385874 2594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:15.391089 2594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab
--principal=oryx/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:15.392225 2594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:15.393244 2594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:15.403110 2606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:15.403067 2602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:15.403049 2594 server_base.cc:1034] running on GCE node
W20260810 01:37:15.403052 2603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:15.403697 2594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:15.404379 2594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:15.405541 2594 hybrid_clock.cc:648] HybridClock initialized: now 1786325835405521 us; error 31 us; skew 500 ppm
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:15.408381 2594 init.cc:377] Logged in from keytab as oryx/127.24.205.129@KRBTEST.COM (short username oryx)
I20260810 01:37:15.409319 2594 webserver.cc:460] Webserver started at http://127.24.205.129:46497/ using document root <none> and password file <none>
I20260810 01:37:15.409935 2594 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:15.410030 2594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:15.410274 2594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:15.412351 2594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "97da4630f90448bc98095cff5d9b8d03"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "9f44f10e38ba97313e6b9c37476cab34"
server_key_iv: "9de7d11a505bcc4e550e917acb5235a3"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.412937 2594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "97da4630f90448bc98095cff5d9b8d03"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "9f44f10e38ba97313e6b9c37476cab34"
server_key_iv: "9de7d11a505bcc4e550e917acb5235a3"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.416880 2594 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:37:15.419296 2616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.420524 2594 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:15.420660 2594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "97da4630f90448bc98095cff5d9b8d03"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "9f44f10e38ba97313e6b9c37476cab34"
server_key_iv: "9de7d11a505bcc4e550e917acb5235a3"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.420789 2594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:15.444339 2594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:15.447813 2594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:15.448035 2594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:15.448729 2594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:15.449590 2594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:15.449663 2594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.449738 2594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:15.449785 2594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.459694 2594 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:33801
I20260810 01:37:15.459733 2786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:33801 every 8 connection(s)
I20260810 01:37:15.460695 2594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:15.464442 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 2594
I20260810 01:37:15.464552 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:15.464893 25398 external_mini_cluster.cc:1428] Setting key b56edb241290bd1b1441b61d6d46811e
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:37:15.475910 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:15.462561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:45869 (local address 127.24.205.190:41855)
0810 01:37:15.462721 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:15.462726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:15.463596 (+ 870us) server_negotiation.cc:407] Connection header received
0810 01:37:15.465243 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:15.465249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:15.465304 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:15.465424 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:15.466815 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.467370 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.468636 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.469008 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.469161 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:15.472129 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:15.472132 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:15.472135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:15.472161 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:15.473664 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.474220 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.474223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.474225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.474311 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.474681 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.474685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.474687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.474882 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:15.474993 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:15.475585 (+ 592us) server_negotiation.cc:299] Negotiation successful
0810 01:37:15.475724 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:37:15.476818 2790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:15.462988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.129:45869)
0810 01:37:15.463440 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:15.463484 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:15.465001 (+ 1517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:15.465610 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:15.465616 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:15.466123 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:15.466663 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:15.466678 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.467502 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.467505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:15.468505 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:15.468515 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.469207 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.469211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:15.469401 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:15.470040 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:15.470058 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:15.471910 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:15.473794 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:15.473800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:15.473816 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:15.474103 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:15.474414 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:15.474417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:15.474419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:15.474570 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:15.475007 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:15.475015 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:15.475340 (+ 325us) client_negotiation.cc:769] Sending connection context
0810 01:37:15.475538 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 01:37:15.475894 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":129,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.130@KRBTEST.COM" created.
I20260810 01:37:15.478272 2787 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41855
I20260810 01:37:15.478616 2787 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:15.479254 2787 heartbeater.cc:511] Master 127.24.205.190:41855 requested a full tablet report, sending...
I20260810 01:37:15.480929 2499 ts_manager.cc:194] Registered new tserver with Master: 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:15.482118 2499 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:45869
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab.
Entry for principal oryx/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab.
I20260810 01:37:15.495157 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41855
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab
--principal=oryx/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:15.610080 2793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:15.610338 2793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:15.610409 2793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:15.614480 2793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:15.614537 2793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:15.614637 2793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:15.619927 2793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab
--principal=oryx/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:15.620981 2793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:15.622061 2793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:15.631778 2805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:15.631917 2808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:15.631812 2793 server_base.cc:1034] running on GCE node
W20260810 01:37:15.631829 2804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:15.632434 2793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:15.633140 2793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:15.634342 2793 hybrid_clock.cc:648] HybridClock initialized: now 1786325835634299 us; error 48 us; skew 500 ppm
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:15.637247 2793 init.cc:377] Logged in from keytab as oryx/127.24.205.130@KRBTEST.COM (short username oryx)
I20260810 01:37:15.638092 2793 webserver.cc:460] Webserver started at http://127.24.205.130:45251/ using document root <none> and password file <none>
I20260810 01:37:15.638669 2793 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:15.638762 2793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:15.639002 2793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:15.641094 2793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "0c5e06cc928c45fbab028012f64ca4e0"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "cf66d9c72062f4f777e8e79d479da3b0"
server_key_iv: "18e92b88e71ca52a4e7d5a9e73d36678"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.641671 2793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "0c5e06cc928c45fbab028012f64ca4e0"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "cf66d9c72062f4f777e8e79d479da3b0"
server_key_iv: "18e92b88e71ca52a4e7d5a9e73d36678"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.645440 2793 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:15.647831 2816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.649005 2793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:15.649139 2793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "0c5e06cc928c45fbab028012f64ca4e0"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "cf66d9c72062f4f777e8e79d479da3b0"
server_key_iv: "18e92b88e71ca52a4e7d5a9e73d36678"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.649248 2793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:15.661279 2793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:15.664438 2793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:15.664638 2793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:15.665189 2793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:15.665982 2793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:15.666054 2793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.666116 2793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:15.666159 2793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.675346 2793 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36081
I20260810 01:37:15.675383 3000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36081 every 8 connection(s)
I20260810 01:37:15.676318 2793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:15.682581 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 2793
I20260810 01:37:15.682723 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:15.683024 25398 external_mini_cluster.cc:1428] Setting key e54cf3ed0a48dedd5dc2cdb76db7899a
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:15.691711 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:15.678124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:48479 (local address 127.24.205.190:41855)
0810 01:37:15.678265 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:15.678269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:15.679087 (+ 818us) server_negotiation.cc:407] Connection header received
0810 01:37:15.680531 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:15.680535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:15.680591 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:15.680674 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:15.681806 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.682377 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.683792 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.684017 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.684193 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:15.687178 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:15.687185 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:15.687189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:15.687224 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:15.689278 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.689791 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.689798 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.689802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.689920 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.690362 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.690369 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.690373 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.690662 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:15.690781 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:15.691304 (+ 523us) server_negotiation.cc:299] Negotiation successful
0810 01:37:15.691453 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:37:15.692358 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:15.678503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.130:48479)
0810 01:37:15.678930 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:15.678972 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:15.680309 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:15.680838 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:15.680845 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:15.681190 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:15.681658 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:15.681671 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.682507 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.682517 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:15.683673 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:15.683683 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.684252 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.684256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:15.684481 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:15.685427 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:15.685443 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:15.686989 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:15.689397 (+ 2408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:15.689402 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:15.689414 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:15.689676 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:15.690053 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:15.690055 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:15.690057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:15.690236 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:15.690781 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:15.690786 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:15.691035 (+ 249us) client_negotiation.cc:769] Sending connection context
0810 01:37:15.691197 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 01:37:15.691438 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":108,"threads_started":1}
I20260810 01:37:15.693531 3001 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41855
I20260810 01:37:15.693775 3001 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:15.694249 3001 heartbeater.cc:511] Master 127.24.205.190:41855 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:37:15.695333 2499 ts_manager.cc:194] Registered new tserver with Master: 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130:36081)
I20260810 01:37:15.695996 2499 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:48479
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab.
Entry for principal oryx/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab.
I20260810 01:37:15.713035 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41855
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab
--principal=oryx/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:15.829931 3008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:15.830185 3008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:15.830271 3008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:15.834331 3008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:15.834391 3008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:15.834496 3008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:15.839908 3008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab
--principal=oryx/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:15.840998 3008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:15.842108 3008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:15.851958 3020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:15.851949 3022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:15.851971 3024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:15.852216 3008 server_base.cc:1034] running on GCE node
I20260810 01:37:15.852780 3008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:15.853451 3008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:15.854655 3008 hybrid_clock.cc:648] HybridClock initialized: now 1786325835854641 us; error 35 us; skew 500 ppm
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:15.857518 3008 init.cc:377] Logged in from keytab as oryx/127.24.205.131@KRBTEST.COM (short username oryx)
I20260810 01:37:15.858460 3008 webserver.cc:460] Webserver started at http://127.24.205.131:37429/ using document root <none> and password file <none>
I20260810 01:37:15.859052 3008 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:15.859149 3008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:15.859395 3008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:15.861536 3008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "f77a5a1257de4dda807343710353bef3"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "4b690497fa1c4346bfd8d0b5169d0c14"
server_key_iv: "6b5b5c6ca1d9e1782e36fe39a609593e"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.862138 3008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "f77a5a1257de4dda807343710353bef3"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "4b690497fa1c4346bfd8d0b5169d0c14"
server_key_iv: "6b5b5c6ca1d9e1782e36fe39a609593e"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.865984 3008 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:15.868530 3036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.869750 3008 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:15.869894 3008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "f77a5a1257de4dda807343710353bef3"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "4b690497fa1c4346bfd8d0b5169d0c14"
server_key_iv: "6b5b5c6ca1d9e1782e36fe39a609593e"
server_key_version: "encryptionkey@0"
I20260810 01:37:15.870015 3008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:15.917943 3008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:15.921420 3008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:15.921579 3008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:15.922129 3008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:15.922950 3008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:15.922998 3008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.923040 3008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:15.923063 3008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:15.931852 3008 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:40561
I20260810 01:37:15.931921 3204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:40561 every 8 connection(s)
I20260810 01:37:15.932852 3008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:15.940824 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 3008
I20260810 01:37:15.940994 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:15.941308 25398 external_mini_cluster.cc:1428] Setting key 61432ebdd036696c95f2fa9f3cb7263e
Aug 10 01:37:15 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:15.947992 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:15.934737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:53773 (local address 127.24.205.190:41855)
0810 01:37:15.934879 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:15.934882 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:15.935660 (+ 778us) server_negotiation.cc:407] Connection header received
0810 01:37:15.937182 (+ 1522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:15.937186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:15.937251 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:15.937371 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:15.938602 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.939157 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.940436 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.940805 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.940947 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:15.944258 (+ 3311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:15.944267 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:15.944270 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:15.944295 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:15.945819 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.946378 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.946382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.946383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.946463 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:15.946830 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:15.946833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:15.946835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:15.947031 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:15.947146 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:15.947674 (+ 528us) server_negotiation.cc:299] Negotiation successful
0810 01:37:15.947818 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:37:15.948851 3208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:15.935061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.131:53773)
0810 01:37:15.935503 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:15.935547 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:15.936945 (+ 1398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:15.937560 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:15.937567 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:15.937943 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:15.938434 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:15.938448 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.939303 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.939312 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:15.940299 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:15.940310 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:15.941049 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:15.941057 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:15.941263 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:15.942031 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:15.942048 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:15.944046 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:15.945951 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:15.945957 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:15.945974 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:15.946254 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:15.946564 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:15.946567 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:15.946569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:15.946720 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:15.947146 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:15.947154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:15.947421 (+ 267us) client_negotiation.cc:769] Sending connection context
0810 01:37:15.947614 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 01:37:15.947956 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":110,"threads_started":1}
I20260810 01:37:15.950009 3206 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41855
I20260810 01:37:15.950251 3206 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:15.950698 3206 heartbeater.cc:511] Master 127.24.205.190:41855 requested a full tablet report, sending...
I20260810 01:37:15.951692 2499 ts_manager.cc:194] Registered new tserver with Master: f77a5a1257de4dda807343710353bef3 (127.24.205.131:40561)
I20260810 01:37:15.952303 2499 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:53773
I20260810 01:37:15.955492 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.205.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.189.keytab.
Entry for principal oryx/127.24.205.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.189.keytab.
I20260810 01:37:15.984508 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:36963
--webserver_interface=127.24.205.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.189.keytab
--principal=oryx/127.24.205.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41855,127.24.205.189:36963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:16.099036 3212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:16.099318 3212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:16.099402 3212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:16.103282 3212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:16.103374 3212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:16.103411 3212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:16.103466 3212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:16.103505 3212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:16.108676 3212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41855,127.24.205.189:36963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.189.keytab
--principal=oryx/127.24.205.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:36963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.205.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
W20260810 01:37:16.108897 3212 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.24.205.190:41855,127.24.205.189:36963'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 01:37:16.109763 3212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:16.110759 3212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:16.119199 3223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.119199 3220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.119222 3226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:16.119580 3212 server_base.cc:1034] running on GCE node
I20260810 01:37:16.120291 3212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:16.121452 3212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:16.122645 3212 hybrid_clock.cc:648] HybridClock initialized: now 1786325836122632 us; error 27 us; skew 500 ppm
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:16.125738 3212 init.cc:377] Logged in from keytab as oryx/127.24.205.189@KRBTEST.COM (short username oryx)
I20260810 01:37:16.126652 3212 webserver.cc:460] Webserver started at http://127.24.205.189:34627/ using document root <none> and password file <none>
I20260810 01:37:16.127236 3212 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:16.127336 3212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:16.127578 3212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:16.129742 3212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/instance:
uuid: "3844064d72ee48f386b193219e8da24e"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "6bb1a6d124011b8ce5f2577771b71741"
server_key_iv: "d84ee3ad60cbcaafe48cb972234c04c5"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.130333 3212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal/instance:
uuid: "3844064d72ee48f386b193219e8da24e"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "6bb1a6d124011b8ce5f2577771b71741"
server_key_iv: "d84ee3ad60cbcaafe48cb972234c04c5"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.134167 3212 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:16.136642 3234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.137899 3212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:16.138056 3212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
uuid: "3844064d72ee48f386b193219e8da24e"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "6bb1a6d124011b8ce5f2577771b71741"
server_key_iv: "d84ee3ad60cbcaafe48cb972234c04c5"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.138173 3212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:16.153301 3212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:16.156703 3212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:16.156922 3212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:16.164557 3212 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.189:36963
I20260810 01:37:16.164872 3313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.189:36963 every 8 connection(s)
I20260810 01:37:16.165635 3212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
I20260810 01:37:16.168507 3315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:16.171610 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 3212
I20260810 01:37:16.172247 3315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.189@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.205.189@KRBTEST.COM
I20260810 01:37:16.185367 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.174537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58240 (local address 127.24.205.190:41855)
0810 01:37:16.174688 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.174692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.175064 (+ 372us) server_negotiation.cc:407] Connection header received
0810 01:37:16.175273 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.175277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.175336 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.175438 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.176388 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.176895 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.177977 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.178241 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.178318 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.181014 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.181019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.181022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.181054 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.182867 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.183481 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.183486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.183491 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.183588 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.184035 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.184039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.184041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.184370 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.184482 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.185059 (+ 577us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.185185 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 01:37:16.186101 3319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.173161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33212 (local address 127.24.205.189:36963)
0810 01:37:16.173607 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.173626 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.173665 (+ 39us) server_negotiation.cc:407] Connection header received
0810 01:37:16.174566 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.174594 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.175011 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.175303 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.176116 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.177141 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.178048 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.178480 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.178580 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.181580 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.181591 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.181604 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.181629 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.183411 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.183944 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.183949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.183951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.184071 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.184392 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.184396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.184400 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.184721 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.184870 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.185156 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.185324 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":95,"server-negotiator.queue_time_us":309,"spinlock_wait_cycles":1280,"thread_start_us":109,"threads_started":1}
I20260810 01:37:16.186100 3320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.174465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58240)
0810 01:37:16.174933 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.174977 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.175141 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.175503 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.175508 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.175892 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.176240 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.176253 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.177022 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.177025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.177847 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.177857 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.178379 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.178382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.178545 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.179336 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.179351 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.180856 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.182989 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.182997 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.183005 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.183378 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.183710 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.183725 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.183727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.183914 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.184492 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.184496 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.184741 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.184941 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.185263 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":5,"spinlock_wait_cycles":4864,"thread_start_us":127,"threads_started":1}
I20260810 01:37:16.187740 3315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.189@KRBTEST.COM for oryx/127.24.205.189@KRBTEST.COM
I20260810 01:37:16.195537 3320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.188355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.0.0.1:33228)
0810 01:37:16.188490 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.188507 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.188582 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.188881 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.188883 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.189055 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.189135 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.189141 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.189860 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.189863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.190372 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.190379 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.190842 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.190845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.190931 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.191324 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.191334 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.192579 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.194257 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.194259 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.194261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.194452 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.194697 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.194699 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.194700 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.194781 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.195130 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.195132 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.195215 (+ 83us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.195310 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.195404 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 01:37:16.195562 3319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.188586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33228 (local address 127.24.205.189:36963)
0810 01:37:16.188704 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.188708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.188719 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:37:16.188746 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.188748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.188786 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.188869 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.189248 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.189745 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.190495 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.190735 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.190843 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.192708 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.192711 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.192719 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.192741 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.194153 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.194545 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.194547 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.194549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.194619 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.194859 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.194861 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.194862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.195018 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.195092 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.195364 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.195448 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:37:16.198558 3315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Bootstrap starting.
I20260810 01:37:16.200819 3315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:16.201532 3315 log.cc:824] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:16.203328 3315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: No bootstrap required, opened a new log
I20260810 01:37:16.206262 3315 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } }
I20260810 01:37:16.206444 3315 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:16.206537 3315 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3844064d72ee48f386b193219e8da24e, State: Initialized, Role: FOLLOWER
I20260810 01:37:16.207006 3315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } }
I20260810 01:37:16.207499 3323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } } }
I20260810 01:37:16.207638 3323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:37:16.208253 3315 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: configured and running, proceeding with master startup.
W20260810 01:37:16.213129 3336 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:37:16.213223 3336 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:37:16.215612 3212 master_runner.cc:428] Detected that this master 3844064d72ee48f386b193219e8da24e is joining an existing cluster
I20260810 01:37:16.215682 3212 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.205.189:36963
I20260810 01:37:16.226276 3323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:16.226436 3323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } }
I20260810 01:37:16.226934 3319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.217728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33240 (local address 127.24.205.189:36963)
0810 01:37:16.217993 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.217998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.218196 (+ 198us) server_negotiation.cc:407] Connection header received
0810 01:37:16.218368 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.218372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.218408 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.218452 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.219055 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.219799 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.221005 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.221291 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.221409 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.223254 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.223258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.223261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.223287 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.224862 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.225490 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.225493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.225495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.225582 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.225923 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.225926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.225928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.226170 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.226272 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.226621 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.226741 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":200}
I20260810 01:37:16.227568 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.217838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.0.0.1:33240)
0810 01:37:16.218123 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.218138 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.218273 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.218592 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.218595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.218835 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.218957 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.218965 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.219932 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.219938 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.220889 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.220901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.221419 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.221422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.221531 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.222621 (+ 1090us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.222640 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.223106 (+ 466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.225011 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.225014 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.225016 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.225331 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.225697 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.225703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.225706 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.225793 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.226260 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.226263 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.226399 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.227221 (+ 822us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.227358 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":3,"spinlock_wait_cycles":8448,"thread_start_us":117,"threads_started":1}
I20260810 01:37:16.228160 2508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3844064d72ee48f386b193219e8da24e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f6d350e4ba43698a548322594c6019" is_pre_election: true
I20260810 01:37:16.229353 3345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.217653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58248)
0810 01:37:16.218127 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.218139 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.218274 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.218537 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.218540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.218753 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.218858 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.218864 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.221035 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.221038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.222023 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.222036 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.222735 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.222739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.222835 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.223588 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.223628 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.225295 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.227701 (+ 2406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.227705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.227708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.227961 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.228301 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.228304 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.228306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.228398 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.228839 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.228843 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.228934 (+ 91us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.229044 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.229176 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":63,"spinlock_wait_cycles":9472,"thread_start_us":106,"threads_started":1}
I20260810 01:37:16.229449 3235 leader_election.cc:302] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3844064d72ee48f386b193219e8da24e; no voters: 97f6d350e4ba43698a548322594c6019
I20260810 01:37:16.229387 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.217728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58248 (local address 127.24.205.190:41855)
0810 01:37:16.217844 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.217848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.218221 (+ 373us) server_negotiation.cc:407] Connection header received
0810 01:37:16.218385 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.218388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.218440 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.218523 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.218980 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.219808 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.222181 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.222601 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.222720 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.225434 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.225439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.225442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.225472 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.227563 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.228096 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.228103 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.228107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.228193 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.228507 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.228512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.228516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.228740 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.228835 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.229099 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.229250 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:37:16.227626 3323 leader_election.cc:288] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855)
I20260810 01:37:16.230347 3323 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.190@KRBTEST.COM for oryx/127.24.205.189@KRBTEST.COM
I20260810 01:37:16.243875 3319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.233882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33252 (local address 127.24.205.189:36963)
0810 01:37:16.234011 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.234015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.234374 (+ 359us) server_negotiation.cc:407] Connection header received
0810 01:37:16.234549 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.234551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.234593 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.234661 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.235407 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.235856 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.237127 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.237342 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.237430 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.239999 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.240003 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.240006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.240036 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.241722 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.242203 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.242208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.242210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.242296 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.242776 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.242780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.242781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.242951 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.243009 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.243544 (+ 535us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.243672 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:37:16.244508 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.233852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.0.0.1:33252)
0810 01:37:16.234230 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.234286 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.234420 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.234727 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.234733 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.235159 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.235293 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.235301 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.235959 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.235962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.236987 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.236998 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.237463 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.237467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.237583 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.238121 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.238137 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.239865 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.241832 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.241842 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.241848 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.242089 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.242442 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.242445 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.242447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.242569 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.243114 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.243125 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.243293 (+ 168us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.244024 (+ 731us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.244287 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":107,"threads_started":1}
I20260810 01:37:16.245877 2499 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.205.189:36963: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3844064d72ee48f386b193219e8da24e"
member_type: NON_VOTER
last_known_addr {
host: "127.24.205.189"
port: 36963
}
attrs {
promote: true
}
}
dest_uuid: "97f6d350e4ba43698a548322594c6019"
cas_config_opid_index: -1
I20260810 01:37:16.246487 2499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } }
I20260810 01:37:16.248262 3353 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3844064d72ee48f386b193219e8da24e (127.24.205.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } }
I20260810 01:37:16.249159 3277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:16.250445 3277 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Refusing update from remote peer 97f6d350e4ba43698a548322594c6019: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:37:16.250541 3353 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.205.189:36963
I20260810 01:37:16.251291 3212 master.cc:537] Master@127.24.205.189:36963 shutting down...
I20260810 01:37:16.251314 3352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.24.205.188@KRBTEST.COM; defaulting to no policy
I20260810 01:37:16.252843 3355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } }
I20260810 01:37:16.253624 3355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
W20260810 01:37:16.255620 2476 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.188@KRBTEST.COM" created.
I20260810 01:37:16.256611 3212 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:16.256844 3212 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:16.256917 3212 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: stopping tablet replica
W20260810 01:37:16.259510 2476 connection.cc:535] client connection to 127.24.205.189:36963 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:37:16.259634 2476 consensus_peers.cc:487] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 -> Peer 3844064d72ee48f386b193219e8da24e (127.24.205.189:36963): Couldn't send request to peer 3844064d72ee48f386b193219e8da24e. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:37:16.261946 3212 master.cc:552] Master@127.24.205.189:36963 shutdown complete.
I20260810 01:37:16.261999 3212 master_runner.cc:305] Clearing existing system tablet
I20260810 01:37:16.262245 3212 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:16.262303 3212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:16.263664 3212 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 01:37:16.264755 3363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.265019 3212 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:16.265146 3212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 01:37:16.265180 3212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
uuid: "3844064d72ee48f386b193219e8da24e"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "6bb1a6d124011b8ce5f2577771b71741"
server_key_iv: "d84ee3ad60cbcaafe48cb972234c04c5"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.267522 3212 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:16.271297 3212 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 01:37:16.271392 3212 log.cc:1196] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 01:37:16.271689 3212 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Deleting consensus metadata
I20260810 01:37:16.271876 3212 master_runner.cc:315] Copying system tablet from 127.24.205.190:41855
I20260810 01:37:16.273504 3212 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: tablet copy: Beginning tablet copy session from remote peer at address 127.24.205.190:41855
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.188.keytab.
Entry for principal oryx/127.24.205.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.188.keytab.
I20260810 01:37:16.275730 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:33445
--webserver_interface=127.24.205.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.188.keytab
--principal=oryx/127.24.205.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:37:16.283896 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.274139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58252)
0810 01:37:16.274423 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.274437 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.275121 (+ 684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.275485 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.275491 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.275737 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.275889 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.275902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.277032 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.277040 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.277926 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.277937 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.278444 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.278448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.278534 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.279262 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.279278 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.279701 (+ 423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.282090 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.282094 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.282096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.282365 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.282713 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.282716 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.282718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.282817 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.283339 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.283342 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.283449 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.283560 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.283710 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":94,"threads_started":1}
I20260810 01:37:16.284333 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.274228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58252 (local address 127.24.205.190:41855)
0810 01:37:16.274370 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.274376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.274524 (+ 148us) server_negotiation.cc:407] Connection header received
0810 01:37:16.275281 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.275284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.275344 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.275435 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.276035 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.276896 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.278061 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.278309 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.278427 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.279870 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.279877 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.279884 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.279919 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.281958 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.282481 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.282486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.282491 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.282598 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.282928 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.282934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.282937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.283226 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.283348 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.283655 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.283807 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:37:16.285128 2531 tablet_copy_service.cc:140] P 97f6d350e4ba43698a548322594c6019: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3844064d72ee48f386b193219e8da24e ({username='oryx', principal='oryx/127.24.205.189@KRBTEST.COM'} at 127.0.0.1:58252)
I20260810 01:37:16.285320 2531 tablet_copy_service.cc:161] P 97f6d350e4ba43698a548322594c6019: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3844064d72ee48f386b193219e8da24e at {username='oryx', principal='oryx/127.24.205.189@KRBTEST.COM'} at 127.0.0.1:58252: session id = 3844064d72ee48f386b193219e8da24e-00000000000000000000000000000000
I20260810 01:37:16.287842 2531 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:37:16.289911 3212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 01:37:16.292423 3212 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: tablet copy: Starting download of 0 data blocks...
I20260810 01:37:16.292620 3212 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: tablet copy: Starting download of 1 WAL segments...
I20260810 01:37:16.294384 3212 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:37:16.296144 2531 tablet_copy_service.cc:342] P 97f6d350e4ba43698a548322594c6019: Request end of tablet copy session 3844064d72ee48f386b193219e8da24e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.205.189@KRBTEST.COM'} at 127.0.0.1:58252
I20260810 01:37:16.296247 2531 tablet_copy_service.cc:433] P 97f6d350e4ba43698a548322594c6019: ending tablet copy session 3844064d72ee48f386b193219e8da24e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3844064d72ee48f386b193219e8da24e
I20260810 01:37:16.304394 3212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:16.306190 3379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.309171 3380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.309333 3382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:16.312244 3212 server_base.cc:1034] running on GCE node
I20260810 01:37:16.312423 3212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:16.312727 3212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:16.313879 3212 hybrid_clock.cc:648] HybridClock initialized: now 1786325836313850 us; error 48 us; skew 500 ppm
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:16.315690 3212 init.cc:377] Logged in from keytab as oryx/127.24.205.189@KRBTEST.COM (short username oryx)
I20260810 01:37:16.316278 3212 webserver.cc:460] Webserver started at http://127.24.205.189:38481/ using document root <none> and password file <none>
I20260810 01:37:16.316488 3212 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:16.316533 3212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:16.317997 3212 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:16.319101 3394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.319348 3212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:16.319433 3212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
uuid: "3844064d72ee48f386b193219e8da24e"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "6bb1a6d124011b8ce5f2577771b71741"
server_key_iv: "d84ee3ad60cbcaafe48cb972234c04c5"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.319516 3212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:16.333926 3212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:16.336484 3212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:16.341835 3212 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.189:36963
I20260810 01:37:16.341960 3474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.189:36963 every 8 connection(s)
I20260810 01:37:16.342470 3212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
I20260810 01:37:16.344614 3479 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:37:16.345741 3479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Bootstrap starting.
I20260810 01:37:16.357074 3479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:37:16.357465 3479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Bootstrap complete.
I20260810 01:37:16.358080 3479 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } }
I20260810 01:37:16.358230 3479 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3844064d72ee48f386b193219e8da24e, State: Initialized, Role: LEARNER
I20260810 01:37:16.358362 3479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } }
I20260810 01:37:16.358734 3482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } }
I20260810 01:37:16.358845 3479 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:16.358942 3482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: LEARNER
I20260810 01:37:16.362131 3503 catalog_manager.cc:1259] Loaded cluster ID: 506ea438ae0844cbb5c7e9b10d96c4c0
I20260810 01:37:16.362254 3503 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: loading cluster ID for follower catalog manager: success
I20260810 01:37:16.364423 3503 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: acquiring CA information for follower catalog manager: success
I20260810 01:37:16.365779 3503 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 01:37:16.414655 3378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:16.414911 3378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:16.414947 3378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:16.418864 3378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:16.418918 3378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:16.418938 3378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:16.419003 3378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:16.419040 3378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:16.424608 3378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.188.keytab
--principal=oryx/127.24.205.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:33445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.205.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:16.425678 3378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:16.426712 3378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:16.435350 3511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.435349 3513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:16.435491 3378 server_base.cc:1034] running on GCE node
W20260810 01:37:16.435381 3509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:16.436329 3378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:16.437480 3378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:16.438675 3378 hybrid_clock.cc:648] HybridClock initialized: now 1786325836438667 us; error 35 us; skew 500 ppm
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:16.441514 3378 init.cc:377] Logged in from keytab as oryx/127.24.205.188@KRBTEST.COM (short username oryx)
I20260810 01:37:16.442515 3378 webserver.cc:460] Webserver started at http://127.24.205.188:36647/ using document root <none> and password file <none>
I20260810 01:37:16.443145 3378 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:16.443239 3378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:16.443457 3378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:16.445539 3378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/instance:
uuid: "c03da910113948c991105b0a7be65c51"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "daff0a88ee1c42b7055209d692702b53"
server_key_iv: "4da26675d2ba9d165beb63885c044d44"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.446127 3378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal/instance:
uuid: "c03da910113948c991105b0a7be65c51"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "daff0a88ee1c42b7055209d692702b53"
server_key_iv: "4da26675d2ba9d165beb63885c044d44"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.449889 3378 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260810 01:37:16.452195 3522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.453429 3378 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:16.453574 3378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
uuid: "c03da910113948c991105b0a7be65c51"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "daff0a88ee1c42b7055209d692702b53"
server_key_iv: "4da26675d2ba9d165beb63885c044d44"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.453685 3378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:16.484519 2787 heartbeater.cc:503] Master 127.24.205.190:41855 was elected leader, sending a full tablet report...
I20260810 01:37:16.491016 3378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:16.494297 3378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:16.494510 3378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:16.502658 3378 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.188:33445
I20260810 01:37:16.502998 3614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.188:33445 every 8 connection(s)
I20260810 01:37:16.503738 3378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
I20260810 01:37:16.504242 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 3378
I20260810 01:37:16.507091 3616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:16.511071 3616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.205.188@KRBTEST.COM
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.188@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:16.520546 3618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.506029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.24.205.188:33445)
0810 01:37:16.506484 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.506499 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.506537 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:37:16.507298 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.507316 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.507642 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.507996 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.508867 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.509937 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.510938 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.511463 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.511635 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.514624 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.514638 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.514647 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.514675 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.516748 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.517366 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.517371 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.517376 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.517523 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.517901 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.517907 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.517911 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.518476 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.518680 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.519069 (+ 389us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.519404 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":147,"threads_started":1}
I20260810 01:37:16.523414 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.513090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.24.205.190:41855)
0810 01:37:16.513262 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.513269 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.513518 (+ 249us) server_negotiation.cc:407] Connection header received
0810 01:37:16.513654 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.513657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.513717 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.513811 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.514535 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.515067 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.516117 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.516351 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.516472 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.518989 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.518994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.518996 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.519031 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.520703 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.522061 (+ 1358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.522064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.522065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.522151 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.522444 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.522447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.522448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.522624 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.522751 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.523123 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.523247 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 01:37:16.523432 3619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.512816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58254)
0810 01:37:16.513375 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.513425 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.513560 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.513861 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.513865 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.514267 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.514400 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.514406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.515219 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.515221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.515952 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.515967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.516472 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.516476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.516606 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.517146 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.517162 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.518833 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.521646 (+ 2813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.521659 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.521664 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.521945 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.522250 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.522253 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.522255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.522351 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.522746 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.522753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.522877 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.523048 (+ 171us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.523257 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":164,"threads_started":1}
I20260810 01:37:16.524714 3616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.188@KRBTEST.COM for oryx/127.24.205.189@KRBTEST.COM
I20260810 01:37:16.532915 3619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.525244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.0.0.1:33262)
0810 01:37:16.525372 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.525386 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.525463 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.525877 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.525879 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.526014 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.526112 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.526117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.527041 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.527043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.527582 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.527589 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.528020 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.528022 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.528188 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.528687 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.528702 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.529937 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.531571 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.531573 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.531575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.531775 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.532028 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.532031 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.532032 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.532163 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.532519 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.532521 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.532604 (+ 83us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.532685 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.532795 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 01:37:16.532995 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.525405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33262 (local address 127.24.205.189:36963)
0810 01:37:16.525673 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.525677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.525690 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:16.525728 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.525730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.525770 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.525850 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.526243 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.526945 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.527694 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.527922 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.528002 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.530085 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.530088 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.530090 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.530115 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.531468 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.531862 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.531864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.531865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.531947 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.532247 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.532249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.532250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.532434 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.532516 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.532746 (+ 230us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.532854 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":116,"threads_started":1}
I20260810 01:37:16.533978 3616 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.188@KRBTEST.COM for oryx/127.24.205.188@KRBTEST.COM
I20260810 01:37:16.542286 3619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.534535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.0.0.1:48574)
0810 01:37:16.534651 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.534664 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.534732 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.534957 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.534959 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.535112 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.535189 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.535194 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.536356 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.536359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.536887 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.536895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.537288 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.537290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.537347 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.537923 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.537935 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.539153 (+ 1218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.540793 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.540795 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.540796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.541019 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.541272 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.541274 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.541275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.541359 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.541749 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.541751 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.541839 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.541951 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.542093 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 01:37:16.542309 3618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.534653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48574 (local address 127.24.205.188:33445)
0810 01:37:16.534768 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.534771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.534782 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:37:16.534810 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.534812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.534846 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.534912 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.535289 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.536243 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.536981 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.537199 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.537274 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.539306 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.539309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.539311 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.539332 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.540690 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.541116 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.541118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.541119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.541189 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.541466 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.541469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.541471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.541645 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.541756 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.542013 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.542174 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":42}
I20260810 01:37:16.545627 3616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Bootstrap starting.
I20260810 01:37:16.548030 3616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:16.548856 3616 log.cc:824] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:16.550887 3616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: No bootstrap required, opened a new log
I20260810 01:37:16.554083 3616 raft_consensus.cc:348] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } }
I20260810 01:37:16.554306 3616 raft_consensus.cc:374] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:16.554342 3616 raft_consensus.cc:729] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03da910113948c991105b0a7be65c51, State: Initialized, Role: FOLLOWER
I20260810 01:37:16.554740 3616 consensus_queue.cc:260] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } }
I20260810 01:37:16.555217 3622 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } } }
I20260810 01:37:16.555365 3622 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:37:16.556007 3616 sys_catalog.cc:564] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 01:37:16.561314 3640 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:37:16.561400 3640 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:37:16.564769 3378 master_runner.cc:428] Detected that this master c03da910113948c991105b0a7be65c51 is joining an existing cluster
I20260810 01:37:16.564831 3378 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.205.188:33445
I20260810 01:37:16.574888 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 2594
I20260810 01:37:16.576552 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.567298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58256 (local address 127.24.205.190:41855)
0810 01:37:16.567458 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.567464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.567480 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:37:16.567527 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.567530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.567581 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.567668 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.568295 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.569106 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.570321 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.570653 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.570732 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.572250 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.572254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.572257 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.572295 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.574042 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.574682 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.574686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.574688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.574786 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.575479 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.575482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.575484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.575722 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.575799 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.576221 (+ 422us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.576354 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 01:37:16.576879 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.567936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33266 (local address 127.24.205.189:36963)
0810 01:37:16.568428 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.568433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.568446 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:16.568485 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.568488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.568536 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.568621 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.569168 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.569994 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.571263 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.571604 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.571718 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.573177 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.573181 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.573184 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.573234 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.575014 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.575445 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.575452 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.575457 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.575548 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.575897 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.575901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.575902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.576154 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.576225 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.576581 (+ 356us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.576728 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409}
I20260810 01:37:16.577118 3648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.566909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58256)
0810 01:37:16.567225 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.567242 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.567338 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.567692 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.567699 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.567959 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.568142 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.568160 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.569252 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.569255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.570195 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.570203 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.570905 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.570909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.570998 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.571561 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.571577 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.572080 (+ 503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.574195 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.574198 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.574201 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.574556 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.574914 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.574918 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.574920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.575008 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.575875 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.575880 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.575981 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.576782 (+ 801us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.576926 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":100,"threads_started":1}
I20260810 01:37:16.577390 3653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.567591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.0.0.1:33266)
0810 01:37:16.568283 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.568296 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.568372 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.568667 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.568670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.568911 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.569019 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.569025 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.570137 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.570140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.571112 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.571123 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.571846 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.571851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.572012 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.572495 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.572542 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.573051 (+ 509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.575103 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.575106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.575108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.575349 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.575671 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.575675 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.575677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.575787 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.576299 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.576303 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.576390 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.577055 (+ 665us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.577189 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":90,"spinlock_wait_cycles":896,"thread_start_us":125,"threads_started":1}
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325835, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.190@KRBTEST.COM for oryx/127.24.205.188@KRBTEST.COM
I20260810 01:37:16.609192 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:33801
--local_ip_for_outbound_sockets=127.24.205.129
--tserver_master_addrs=127.24.205.190:41855
--webserver_port=46497
--webserver_interface=127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab
--principal=oryx/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:37:16.633358 3618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.567827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48578 (local address 127.24.205.188:33445)
0810 01:37:16.568081 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.568086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.568099 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:16.568135 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.568138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.568180 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.568271 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.569272 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.570030 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.571672 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.572050 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.572169 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.629750 (+ 57581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.629755 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.629758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.629783 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.631531 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.631977 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.631981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.631983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.632047 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.632405 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.632408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.632410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.632630 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.632696 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.633042 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.633180 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":159,"spinlock_wait_cycles":17152}
I20260810 01:37:16.633876 3651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.566964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.0.0.1:48578)
0810 01:37:16.567933 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.567948 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.568025 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.568741 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.568744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.569004 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.569133 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.569142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.570186 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.570190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.571548 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.571560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.572813 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.572817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.572921 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.629014 (+ 56093us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.629036 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.629558 (+ 522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.631650 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.631653 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.631655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.631883 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.632186 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.632189 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.632191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.632320 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.632754 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.632756 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.632868 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.633576 (+ 708us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.633709 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":69,"spinlock_wait_cycles":39808,"thread_start_us":124,"threads_started":1}
I20260810 01:37:16.634162 3654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.601285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.24.205.188:33445)
0810 01:37:16.602060 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.602075 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.602096 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:37:16.602220 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.602223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.602286 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.602418 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.603159 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.603993 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.605380 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.605757 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.605866 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.608798 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.608803 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.608806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.608836 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.630943 (+ 22107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.632165 (+ 1222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.632169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.632171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.632289 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.632619 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.632623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.632624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.632857 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.632936 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.633859 (+ 923us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.633979 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":120,"threads_started":1}
I20260810 01:37:16.634958 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.581018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.0.0.1:48592)
0810 01:37:16.581268 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.581282 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.581352 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.602527 (+ 21175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.602534 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.602804 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.602980 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.602993 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.604182 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.604188 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.605223 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.605243 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.605919 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.605926 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.606070 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.606720 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.606743 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.608609 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.631107 (+ 22498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.631115 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.631118 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.631994 (+ 876us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.632407 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.632410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.632412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.632515 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.633011 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.633014 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.633128 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.633234 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.633401 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260810 01:37:16.636191 2499 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.205.188:33445: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c03da910113948c991105b0a7be65c51"
member_type: NON_VOTER
last_known_addr {
host: "127.24.205.188"
port: 33445
}
attrs {
promote: true
}
}
dest_uuid: "97f6d350e4ba43698a548322594c6019"
cas_config_opid_index: 5
I20260810 01:37:16.636804 2499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } }
I20260810 01:37:16.637953 3356 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c03da910113948c991105b0a7be65c51 (127.24.205.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.639549 3356 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.205.188:33445
I20260810 01:37:16.639756 3356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.639851 3356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:16.640372 3569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:16.640647 3378 master.cc:537] Master@127.24.205.188:33445 shutting down...
I20260810 01:37:16.641887 3569 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Refusing update from remote peer 97f6d350e4ba43698a548322594c6019: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:37:16.642464 3352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:37:16.645239 2475 consensus_peers.cc:487] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 -> Peer c03da910113948c991105b0a7be65c51 (127.24.205.188:33445): Couldn't send request to peer c03da910113948c991105b0a7be65c51. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:37:16.646265 3378 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:16.646533 3378 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:16.646622 3378 tablet_replica.cc:330] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: stopping tablet replica
I20260810 01:37:16.648742 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.640241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33270 (local address 127.24.205.189:36963)
0810 01:37:16.640361 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.640368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.640383 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:16.640439 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.640444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.640512 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.640611 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:16.641055 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.641893 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.647040 (+ 5147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.647746 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.647850 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.647997 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.648497 (+ 500us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.648597 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 01:37:16.649500 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.638019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.0.0.1:33270)
0810 01:37:16.638157 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.638173 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.638254 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.640770 (+ 2516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.640773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.640794 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:16.640905 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.640911 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.642101 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.642107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.646875 (+ 4768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.646888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.648164 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.648169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.648293 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.648356 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.649292 (+ 936us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.649386 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 01:37:16.650043 3437 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 LEARNER]: Refusing update from remote peer 97f6d350e4ba43698a548322594c6019: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:37:16.650482 3352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:37:16.652698 3378 master.cc:552] Master@127.24.205.188:33445 shutdown complete.
I20260810 01:37:16.652793 3378 master_runner.cc:305] Clearing existing system tablet
I20260810 01:37:16.652572 3437 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c03da910113948c991105b0a7be65c51 (127.24.205.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.653307 3378 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:16.653404 3378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:16.655092 3482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97f6d350e4ba43698a548322594c6019. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.655224 3482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: LEARNER
I20260810 01:37:16.655337 3482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: NON_VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: true } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.655433 3482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: LEARNER
I20260810 01:37:16.657080 3352 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: attempting to promote NON_VOTER 3844064d72ee48f386b193219e8da24e to VOTER
I20260810 01:37:16.657550 3352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } }
I20260810 01:37:16.658797 3437 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 LEARNER]: Refusing update from remote peer 97f6d350e4ba43698a548322594c6019: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:37:16.659011 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.658702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.0.0.1:48594)
0810 01:37:16.658856 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.658940 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260810 01:37:16.659209 3353 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:37:16.659775 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.659504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.0.0.1:48608)
0810 01:37:16.659656 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.659703 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260810 01:37:16.659890 2475 consensus_peers.cc:487] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 -> Peer c03da910113948c991105b0a7be65c51 (127.24.205.188:33445): Couldn't send request to peer c03da910113948c991105b0a7be65c51. Status: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:37:16.661177 3356 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3844064d72ee48f386b193219e8da24e (127.24.205.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.661587 3437 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3844064d72ee48f386b193219e8da24e (127.24.205.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.662659 3356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.662778 3356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:16.662907 3356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.662914 3659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.662984 3356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:16.663014 3659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:37:16.663507 3378 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.001s sys 0.000s
I20260810 01:37:16.664575 3661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.664868 3378 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:16.665334 3378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 01:37:16.665426 3378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
uuid: "c03da910113948c991105b0a7be65c51"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "daff0a88ee1c42b7055209d692702b53"
server_key_iv: "4da26675d2ba9d165beb63885c044d44"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.667711 3378 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:16.670171 3378 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 01:37:16.670333 3378 log.cc:1196] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 01:37:16.670658 3378 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Deleting consensus metadata
I20260810 01:37:16.670884 3378 master_runner.cc:315] Copying system tablet from 127.24.205.190:41855
I20260810 01:37:16.672221 3378 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: tablet copy: Beginning tablet copy session from remote peer at address 127.24.205.190:41855
I20260810 01:37:16.682130 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.672951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.24.205.190:41855)
0810 01:37:16.673098 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.673103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.673297 (+ 194us) server_negotiation.cc:407] Connection header received
0810 01:37:16.673527 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.673531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.673588 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.673688 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.674246 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.675133 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.676519 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.676855 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.676925 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.678434 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.678438 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.678441 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.678468 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.680240 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.680733 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.680736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.680738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.680824 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.681124 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.681128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.681129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.681375 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.681447 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.681832 (+ 385us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.681962 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 01:37:16.683009 3674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.672853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58262)
0810 01:37:16.673200 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.673215 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.673383 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.673746 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.673749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.673977 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.674105 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.674114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.675437 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.675441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.676375 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.676387 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.677091 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.677094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.677206 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.677803 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.677817 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.678273 (+ 456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.680365 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.680368 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.680370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.680620 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.680939 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.680942 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.680944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.681027 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.681522 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.681525 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.681621 (+ 96us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.682646 (+ 1025us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.682807 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":113,"threads_started":1}
I20260810 01:37:16.683727 2531 tablet_copy_service.cc:140] P 97f6d350e4ba43698a548322594c6019: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c03da910113948c991105b0a7be65c51 ({username='oryx', principal='oryx/127.24.205.188@KRBTEST.COM'} at 127.0.0.1:58262)
I20260810 01:37:16.683822 2531 tablet_copy_service.cc:161] P 97f6d350e4ba43698a548322594c6019: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c03da910113948c991105b0a7be65c51 at {username='oryx', principal='oryx/127.24.205.188@KRBTEST.COM'} at 127.0.0.1:58262: session id = c03da910113948c991105b0a7be65c51-00000000000000000000000000000000
I20260810 01:37:16.684984 2531 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:37:16.686440 3378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 01:37:16.689071 3378 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: tablet copy: Starting download of 0 data blocks...
I20260810 01:37:16.689282 3378 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: tablet copy: Starting download of 1 WAL segments...
I20260810 01:37:16.690958 3378 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:37:16.692762 2531 tablet_copy_service.cc:342] P 97f6d350e4ba43698a548322594c6019: Request end of tablet copy session c03da910113948c991105b0a7be65c51-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.205.188@KRBTEST.COM'} at 127.0.0.1:58262
I20260810 01:37:16.692849 2531 tablet_copy_service.cc:433] P 97f6d350e4ba43698a548322594c6019: ending tablet copy session c03da910113948c991105b0a7be65c51-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c03da910113948c991105b0a7be65c51
I20260810 01:37:16.698148 3001 heartbeater.cc:503] Master 127.24.205.190:41855 was elected leader, sending a full tablet report...
I20260810 01:37:16.700258 3378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:16.701921 3680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.702199 3677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.702296 3675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:16.702904 3378 server_base.cc:1034] running on GCE node
I20260810 01:37:16.703064 3378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:16.703372 3378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:16.704524 3378 hybrid_clock.cc:648] HybridClock initialized: now 1786325836704508 us; error 32 us; skew 500 ppm
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:16.706189 3378 init.cc:377] Logged in from keytab as oryx/127.24.205.188@KRBTEST.COM (short username oryx)
I20260810 01:37:16.706667 3378 webserver.cc:460] Webserver started at http://127.24.205.188:33141/ using document root <none> and password file <none>
I20260810 01:37:16.706866 3378 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:16.706912 3378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:16.708349 3378 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:16.709545 3691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.709820 3378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:16.709900 3378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
uuid: "c03da910113948c991105b0a7be65c51"
format_stamp: "Formatted at 2026-08-10 01:37:16 on dist-test-slave-t3q3"
server_key: "daff0a88ee1c42b7055209d692702b53"
server_key_iv: "4da26675d2ba9d165beb63885c044d44"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.709981 3378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:16.725616 3378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:16.728161 3378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:16.733428 3378 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.188:33445
I20260810 01:37:16.734203 3378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
I20260810 01:37:16.736193 3772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.188:33445 every 8 connection(s)
I20260810 01:37:16.737262 3774 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:37:16.738461 3774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Bootstrap starting.
I20260810 01:37:16.747830 3774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:37:16.748208 3774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: Bootstrap complete.
I20260810 01:37:16.748721 3774 raft_consensus.cc:348] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } }
I20260810 01:37:16.748864 3774 raft_consensus.cc:729] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c03da910113948c991105b0a7be65c51, State: Initialized, Role: LEARNER
I20260810 01:37:16.748983 3774 consensus_queue.cc:260] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } }
I20260810 01:37:16.749373 3778 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:16.749534 3774 sys_catalog.cc:564] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:16.749557 3778 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: This master's current role is: LEARNER
I20260810 01:37:16.753202 3792 catalog_manager.cc:1259] Loaded cluster ID: 506ea438ae0844cbb5c7e9b10d96c4c0
I20260810 01:37:16.753328 3792 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: loading cluster ID for follower catalog manager: success
I20260810 01:37:16.755115 3792 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: acquiring CA information for follower catalog manager: success
I20260810 01:37:16.756340 3792 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 01:37:16.759380 3657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:16.759742 3657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:16.759811 3657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:16.765786 3657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:16.765867 3657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:16.765955 3657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:16.773833 3657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab
--principal=oryx/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:33801
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=46497
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:16.775352 3657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:16.776890 3657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:16.788930 3806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.788923 3804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:16.788923 3803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:16.789476 3657 server_base.cc:1034] running on GCE node
I20260810 01:37:16.789968 3657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:16.790817 3657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:16.792044 3657 hybrid_clock.cc:648] HybridClock initialized: now 1786325836792004 us; error 54 us; skew 500 ppm
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:16.794983 3657 init.cc:377] Logged in from keytab as oryx/127.24.205.129@KRBTEST.COM (short username oryx)
I20260810 01:37:16.795838 3657 webserver.cc:460] Webserver started at http://127.24.205.129:46497/ using document root <none> and password file <none>
I20260810 01:37:16.796469 3657 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:16.796551 3657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:16.801198 3657 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260810 01:37:16.804322 3817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.806082 3657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:37:16.806223 3657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "97da4630f90448bc98095cff5d9b8d03"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "9f44f10e38ba97313e6b9c37476cab34"
server_key_iv: "9de7d11a505bcc4e550e917acb5235a3"
server_key_version: "encryptionkey@0"
I20260810 01:37:16.806993 3657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:16.825546 3657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:16.829279 3657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:16.829501 3657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:16.830147 3657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:16.831084 3657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:16.831166 3657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.831238 3657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:16.831290 3657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:16.840342 3657 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:33801
I20260810 01:37:16.840369 3998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:33801 every 8 connection(s)
I20260810 01:37:16.841445 3657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:16.848357 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 3657
I20260810 01:37:16.848562 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 2793
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.189@KRBTEST.COM
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.188@KRBTEST.COM
Aug 10 01:37:16 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325836, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:16.862954 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.843407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:38019 (local address 127.24.205.189:36963)
0810 01:37:16.843756 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.843760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.844587 (+ 827us) server_negotiation.cc:407] Connection header received
0810 01:37:16.845680 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.845683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.845738 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.845833 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.847384 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.847924 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.853819 (+ 5895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.854162 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.854264 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.857382 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.857388 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.857393 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.857424 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.860139 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.860904 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.860910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.860913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.861006 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.861498 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.861503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.861505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.861750 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.861855 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.862598 (+ 743us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.862748 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267}
I20260810 01:37:16.864778 4010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.843800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.24.205.129:38019)
0810 01:37:16.844404 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.844456 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.845439 (+ 983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.846042 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.846055 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.846671 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.847230 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.847244 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.848097 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.848102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.853684 (+ 5582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.853692 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.854429 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.854435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.854559 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.855376 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.855391 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.857200 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.860311 (+ 3111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.860317 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.860333 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.860789 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.861127 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.861132 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.861138 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.861369 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.861925 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.861935 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.862292 (+ 357us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.863213 (+ 921us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.863587 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":44,"thread_start_us":206,"threads_started":1}
I20260810 01:37:16.865846 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.843540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:50277 (local address 127.24.205.188:33445)
0810 01:37:16.843910 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.843924 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.845106 (+ 1182us) server_negotiation.cc:407] Connection header received
0810 01:37:16.845682 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.845685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.845738 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.845833 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.847402 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.848491 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.853010 (+ 4519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.853390 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.853472 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.862060 (+ 8588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.862063 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.862066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.862096 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.863881 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.864401 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.864405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.864406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.864497 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.864828 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.864833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.864838 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.865069 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.865157 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.865527 (+ 370us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.865689 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":76,"threads_started":1}
I20260810 01:37:16.866187 4004 heartbeater.cc:347] Connected to a master server at 127.24.205.189:36963
I20260810 01:37:16.866464 4004 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:16.866811 4011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.843799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.24.205.129:50277)
0810 01:37:16.844994 (+ 1195us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.845009 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.845442 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.846642 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.846645 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.846811 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.847245 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.847255 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.848625 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.848631 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.849991 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.850006 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.853702 (+ 3696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.853706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.853922 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.855257 (+ 1335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.855282 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.861902 (+ 6620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.864010 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.864013 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.864015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.864282 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.864611 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.864614 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.864616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.864714 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.865217 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.865219 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.865334 (+ 115us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.865985 (+ 651us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.866522 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"mutex_wait_us":101,"spinlock_wait_cycles":11136,"thread_start_us":856,"threads_started":1}
I20260810 01:37:16.867089 4004 heartbeater.cc:511] Master 127.24.205.189:36963 requested a full tablet report, sending...
I20260810 01:37:16.867486 3999 heartbeater.cc:347] Connected to a master server at 127.24.205.188:33445
I20260810 01:37:16.867570 3999 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:16.867755 3999 heartbeater.cc:511] Master 127.24.205.188:33445 requested a full tablet report, sending...
I20260810 01:37:16.869024 3701 ts_manager.cc:194] Registered new tserver with Master: 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:16.869134 3423 ts_manager.cc:194] Registered new tserver with Master: 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:16.869199 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:36081
--local_ip_for_outbound_sockets=127.24.205.130
--tserver_master_addrs=127.24.205.190:41855
--webserver_port=45251
--webserver_interface=127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab
--principal=oryx/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:37:16.869485 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.843466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:45425 (local address 127.24.205.190:41855)
0810 01:37:16.843593 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:16.843597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:16.845982 (+ 2385us) server_negotiation.cc:407] Connection header received
0810 01:37:16.846092 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:16.846094 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:16.846136 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:16.846206 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:16.847402 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.858078 (+ 10676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.859415 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.859846 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.859940 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.863362 (+ 3422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:16.863369 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:16.863376 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:16.863413 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:16.865257 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.866481 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.866486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.866488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.866587 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:16.868129 (+ 1542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:16.868134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:16.868136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:16.868336 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:16.868398 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:16.869199 (+ 801us) server_negotiation.cc:299] Negotiation successful
0810 01:37:16.869325 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:37:16.869946 4012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:16.843799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.129:45425)
0810 01:37:16.845901 (+ 2102us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:16.845915 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:16.846009 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:16.846256 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:16.846258 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:16.846642 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:16.847246 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.847255 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.858239 (+ 10984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.858242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.859263 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:16.859277 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:16.860230 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:16.860235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:16.860335 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:16.861282 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:16.861299 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:16.862914 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:16.865712 (+ 2798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.865717 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.865723 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.866363 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.866755 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:16.866759 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:16.866760 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:16.866853 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:16.868903 (+ 2050us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:16.868906 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:16.868993 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 01:37:16.869630 (+ 637us) client_negotiation.cc:240] Negotiation successful
0810 01:37:16.869784 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2010,"mutex_wait_us":228,"spinlock_wait_cycles":1729792,"thread_start_us":898,"threads_started":1}
I20260810 01:37:16.870934 4003 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41855
I20260810 01:37:16.871045 4003 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:16.871222 4003 heartbeater.cc:511] Master 127.24.205.190:41855 requested a full tablet report, sending...
I20260810 01:37:16.872172 2499 ts_manager.cc:194] Re-registered known tserver with Master: 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:16.873075 2499 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:45425
I20260810 01:37:16.954288 3206 heartbeater.cc:503] Master 127.24.205.190:41855 was elected leader, sending a full tablet report...
W20260810 01:37:16.987535 4013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:16.987816 4013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:16.987890 4013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:16.991847 4013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:16.991909 4013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:16.991966 4013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:16.997339 4013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab
--principal=oryx/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:36081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=45251
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:16.998409 4013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:16.999447 4013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:17.009341 4021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:17.009366 4020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:17.009366 4023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:17.009595 4013 server_base.cc:1034] running on GCE node
I20260810 01:37:17.010171 4013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:17.010741 4013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:17.011942 4013 hybrid_clock.cc:648] HybridClock initialized: now 1786325837011865 us; error 94 us; skew 500 ppm
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:17.014771 4013 init.cc:377] Logged in from keytab as oryx/127.24.205.130@KRBTEST.COM (short username oryx)
I20260810 01:37:17.015633 4013 webserver.cc:460] Webserver started at http://127.24.205.130:45251/ using document root <none> and password file <none>
I20260810 01:37:17.016640 4013 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:17.016748 4013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:17.021005 4013 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 01:37:17.023447 4032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:17.024773 4013 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:17.024916 4013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "0c5e06cc928c45fbab028012f64ca4e0"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "cf66d9c72062f4f777e8e79d479da3b0"
server_key_iv: "18e92b88e71ca52a4e7d5a9e73d36678"
server_key_version: "encryptionkey@0"
I20260810 01:37:17.025475 4013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:17.037181 4013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:17.040154 4013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:17.040362 4013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:17.040988 4013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:17.041957 4013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:17.042026 4013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:17.042096 4013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:17.042142 4013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:17.051470 4013 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36081
I20260810 01:37:17.051586 4218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36081 every 8 connection(s)
I20260810 01:37:17.052644 4013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:17.057364 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 4013
I20260810 01:37:17.057570 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 3008
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.189@KRBTEST.COM
I20260810 01:37:17.080286 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.054474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:38341 (local address 127.24.205.190:41855)
0810 01:37:17.054607 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.054611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.055885 (+ 1274us) server_negotiation.cc:407] Connection header received
0810 01:37:17.056764 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.056769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.056824 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.056898 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.068271 (+ 11373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.069064 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.070989 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.071351 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.071456 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.075079 (+ 3623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.075083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.075086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.075122 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.077325 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.078217 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.078224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.078228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.078331 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.078754 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.078757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.078759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.078982 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.079053 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.079873 (+ 820us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.080010 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.188@KRBTEST.COM
I20260810 01:37:17.082515 4229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.054968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.130:38341)
0810 01:37:17.055786 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.055800 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.056464 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.057018 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.057020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.057708 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:17.058347 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.058366 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.069284 (+ 10918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.069291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.070807 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.070827 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.071673 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.071679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.071920 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.072734 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:17.072758 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:17.074855 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:17.077456 (+ 2601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.077462 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.077481 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.078056 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.078443 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.078446 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.078448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.078637 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.079148 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:17.079155 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:17.079487 (+ 332us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.080814 (+ 1327us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.081231 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"mutex_wait_us":26,"spinlock_wait_cycles":16256,"thread_start_us":144,"threads_started":1}
I20260810 01:37:17.084362 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.054478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:43189 (local address 127.24.205.189:36963)
0810 01:37:17.054636 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.054641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.056314 (+ 1673us) server_negotiation.cc:407] Connection header received
0810 01:37:17.056667 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.056670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.056731 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.056785 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.072689 (+ 15904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.073484 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.074731 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.075070 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.075145 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.080131 (+ 4986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.080137 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.080143 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.080180 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.082175 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.082713 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.082719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.082724 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.082819 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.083179 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.083186 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.083190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.083486 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.083588 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.083988 (+ 400us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.084174 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:37:17.084703 4223 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41855
I20260810 01:37:17.084743 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:40561
--local_ip_for_outbound_sockets=127.24.205.131
--tserver_master_addrs=127.24.205.190:41855
--webserver_port=37429
--webserver_interface=127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab
--principal=oryx/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:37:17.084964 4223 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:17.085588 4223 heartbeater.cc:511] Master 127.24.205.190:41855 requested a full tablet report, sending...
I20260810 01:37:17.086251 4230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.055905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.24.205.130:43189)
0810 01:37:17.056216 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.056227 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.056464 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.057009 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.057015 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.072289 (+ 15274us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:17.072472 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.072487 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.073671 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.073677 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.074575 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.074588 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.075323 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.075328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.075452 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.077552 (+ 2100us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:17.077573 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:17.079918 (+ 2345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:17.082323 (+ 2405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.082328 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.082333 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.082593 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.082935 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.082940 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.082945 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.083053 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.083658 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:17.083664 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:17.083779 (+ 115us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.084563 (+ 784us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.084928 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"spinlock_wait_cycles":13184,"thread_start_us":116,"threads_started":1}
I20260810 01:37:17.086496 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.054807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:59181 (local address 127.24.205.188:33445)
0810 01:37:17.054955 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.054960 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.055642 (+ 682us) server_negotiation.cc:407] Connection header received
0810 01:37:17.056657 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.056660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.056723 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.056823 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.077368 (+ 20545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.078178 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.079292 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.079640 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.079724 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.082122 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.082126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.082128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.082157 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.084332 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.085044 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.085047 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.085049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.085143 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.085494 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.085500 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.085505 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.085778 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.085890 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.086203 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.086344 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:37:17.086819 2499 ts_manager.cc:194] Re-registered known tserver with Master: 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130:36081)
I20260810 01:37:17.087065 4228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.054968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.24.205.130:59181)
0810 01:37:17.055472 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.055522 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.056449 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.057001 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.057013 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.077080 (+ 20067us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:17.077204 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.077210 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.078323 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.078326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.079157 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.079165 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.079908 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.079911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.080008 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.080532 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:17.080546 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:17.081956 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:17.084478 (+ 2522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.084481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.084482 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.084830 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.085262 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.085264 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.085266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.085352 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.085905 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:17.085908 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:17.085993 (+ 85us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.086712 (+ 719us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.086901 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":571,"threads_started":1}
I20260810 01:37:17.087620 2499 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:38341
I20260810 01:37:17.087651 4219 heartbeater.cc:347] Connected to a master server at 127.24.205.188:33445
I20260810 01:37:17.087731 4219 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:17.087906 4219 heartbeater.cc:511] Master 127.24.205.188:33445 requested a full tablet report, sending...
I20260810 01:37:17.087916 4226 heartbeater.cc:347] Connected to a master server at 127.24.205.189:36963
I20260810 01:37:17.088243 4226 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:17.088481 4226 heartbeater.cc:511] Master 127.24.205.189:36963 requested a full tablet report, sending...
I20260810 01:37:17.088653 3701 ts_manager.cc:194] Registered new tserver with Master: 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130:36081)
I20260810 01:37:17.089279 3423 ts_manager.cc:194] Registered new tserver with Master: 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130:36081)
I20260810 01:37:17.121417 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.117565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48622 (local address 127.24.205.188:33445)
0810 01:37:17.117704 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.117709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.117727 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:37:17.117849 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.117852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.117919 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.118047 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:17.118290 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.119123 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.120363 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.120854 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.120995 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.121156 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.121196 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.121273 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:37:17.121417 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.117474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.0.0.1:48622)
0810 01:37:17.117622 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.117639 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.117735 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.118060 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.118062 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.118076 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:17.118171 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.118176 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.119282 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.119288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.120167 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.120195 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.120987 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.120991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.121079 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.121103 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.121173 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.121302 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 01:37:17.122212 3734 raft_consensus.cc:1203] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:37:17.122591 3778 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97f6d350e4ba43698a548322594c6019. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:17.122748 3778 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: This master's current role is: LEARNER
W20260810 01:37:17.209869 4231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:17.210235 4231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:17.210314 4231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:17.214637 4231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:17.214701 4231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:17.214759 4231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:17.220018 4231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab
--principal=oryx/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:40561
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=37429
--tserver_master_addrs=127.24.205.190:41855,127.24.205.189:36963,127.24.205.188:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:17.221112 4231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:17.222074 4231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:17.231978 4241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:17.232121 4231 server_base.cc:1034] running on GCE node
W20260810 01:37:17.232002 4237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:17.231988 4238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:17.232887 4231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:17.233474 4231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:17.234673 4231 hybrid_clock.cc:648] HybridClock initialized: now 1786325837234650 us; error 32 us; skew 500 ppm
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:17.237488 4231 init.cc:377] Logged in from keytab as oryx/127.24.205.131@KRBTEST.COM (short username oryx)
I20260810 01:37:17.238332 4231 webserver.cc:460] Webserver started at http://127.24.205.131:37429/ using document root <none> and password file <none>
I20260810 01:37:17.238903 4231 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:17.239022 4231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:17.243139 4231 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:37:17.245255 4253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:17.246508 4231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:17.246656 4231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "f77a5a1257de4dda807343710353bef3"
format_stamp: "Formatted at 2026-08-10 01:37:15 on dist-test-slave-t3q3"
server_key: "4b690497fa1c4346bfd8d0b5169d0c14"
server_key_iv: "6b5b5c6ca1d9e1782e36fe39a609593e"
server_key_version: "encryptionkey@0"
I20260810 01:37:17.247200 4231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:17.265851 4231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:17.268806 4231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:17.269012 4231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:17.269603 4231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:17.270462 4231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:17.270538 4231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:17.270612 4231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:17.270663 4231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:17.280861 4231 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:40561
I20260810 01:37:17.280882 4426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:40561 every 8 connection(s)
I20260810 01:37:17.281862 4231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:17.283344 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 4231
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.188@KRBTEST.COM
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:17.300395 4444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.286945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58268 (local address 127.24.205.190:41855)
0810 01:37:17.287260 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.287265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.288553 (+ 1288us) server_negotiation.cc:407] Connection header received
0810 01:37:17.288745 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.288750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.288797 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.289092 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.290985 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.291805 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.292963 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.293378 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.293490 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.295842 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.295845 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.295848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.295874 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.298042 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.298605 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.298611 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.298614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.298722 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.299054 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.299057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.299059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.299296 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.299433 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.300041 (+ 608us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.300199 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":108,"threads_started":1}
I20260810 01:37:17.300884 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.284218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:51227 (local address 127.24.205.188:33445)
0810 01:37:17.284656 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.284661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.286050 (+ 1389us) server_negotiation.cc:407] Connection header received
0810 01:37:17.287377 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.287380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.287443 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.287520 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.289456 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.290315 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.292061 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.292398 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.292479 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.296356 (+ 3877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.296359 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.296362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.296389 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.298160 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.298887 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.298892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.298893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.298987 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.299423 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.299430 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.299433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.299686 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.299769 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.300586 (+ 817us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.300709 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354}
I20260810 01:37:17.301700 4443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.286749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33278 (local address 127.24.205.189:36963)
0810 01:37:17.288741 (+ 1992us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.288745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.288756 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:37:17.288790 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.288793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.288833 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.289092 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.290487 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.291986 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.293148 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.293474 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.293570 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.296492 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.296495 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.296498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.296523 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.299087 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.299572 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.299575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.299577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.299674 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.299978 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.299981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.299983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.300314 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.301301 (+ 987us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.301400 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.301543 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":685,"server-negotiator.queue_time_us":1920,"thread_start_us":59,"threads_started":1}
Aug 10 01:37:17 dist-test-slave-t3q3 krb5kdc[2428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325837, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.189@KRBTEST.COM
I20260810 01:37:17.303220 4440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.284341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.24.205.131:51227)
0810 01:37:17.285752 (+ 1411us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.285796 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.287188 (+ 1392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.287870 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.287879 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.288459 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:17.289278 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.289298 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.290509 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.290513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.291908 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.291918 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.292677 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.292681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.292893 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.293900 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:17.293926 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:17.295970 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:17.298305 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.298312 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.298327 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.298763 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.299114 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.299117 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.299119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.299303 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.299846 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:17.299855 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:17.300191 (+ 336us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.301051 (+ 860us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.301773 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1220,"mutex_wait_us":63,"spinlock_wait_cycles":50176,"thread_start_us":951,"threads_started":1}
I20260810 01:37:17.305389 4427 heartbeater.cc:347] Connected to a master server at 127.24.205.188:33445
I20260810 01:37:17.305650 4427 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:17.306262 4427 heartbeater.cc:511] Master 127.24.205.188:33445 requested a full tablet report, sending...
I20260810 01:37:17.306483 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.287161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48626 (local address 127.24.205.188:33445)
0810 01:37:17.288602 (+ 1441us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.288607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.289864 (+ 1257us) server_negotiation.cc:407] Connection header received
0810 01:37:17.290059 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.290063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.290112 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.290352 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.291629 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.292387 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.293914 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.294308 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.294369 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.302509 (+ 8140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.302514 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.302520 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.302546 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.304619 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.305133 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.305137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.305138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.305248 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.305549 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.305552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.305553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.305763 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.305859 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.306206 (+ 347us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.306327 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1365,"thread_start_us":92,"threads_started":1}
I20260810 01:37:17.304134 2499 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:37:17.307545 3703 ts_manager.cc:194] Registered new tserver with Master: f77a5a1257de4dda807343710353bef3 (127.24.205.131:40561)
W20260810 01:37:17.308437 2499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:17.309707 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.284342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.131:54827)
0810 01:37:17.285751 (+ 1409us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.285792 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.286990 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.287869 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.287879 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.288689 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:17.289440 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.289448 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.290509 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.290513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.295896 (+ 5383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.295910 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.297701 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.297705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.298107 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.298600 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:17.298617 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:17.303486 (+ 4869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:17.307909 (+ 4423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.307912 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.307914 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.308191 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.308562 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.308566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.308567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.308662 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.309126 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:17.309129 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:17.309216 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.309336 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.309500 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1235,"mutex_wait_us":4172,"spinlock_wait_cycles":69504,"thread_start_us":391,"threads_started":1}
I20260810 01:37:17.309768 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.284486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:54827 (local address 127.24.205.190:41855)
0810 01:37:17.284615 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.284620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.286056 (+ 1436us) server_negotiation.cc:407] Connection header received
0810 01:37:17.287525 (+ 1469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.287529 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.287575 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.287628 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.289562 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.290328 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.296087 (+ 5759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.296431 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.297562 (+ 1131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.303670 (+ 6108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.303674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.303676 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.303701 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.306794 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.308309 (+ 1515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.308313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.308314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.308399 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.308776 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.308780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.308782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.308948 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.309077 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.309465 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.309632 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:37:17.310422 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.284688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.24.205.131:50073)
0810 01:37:17.285752 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.285796 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.288027 (+ 2231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.288744 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.288746 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.288900 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:17.289278 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.289298 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.294058 (+ 4760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.294063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.296165 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.296178 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.297887 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.297893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.298789 (+ 896us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.301110 (+ 2321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:17.301124 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:17.304693 (+ 3569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:17.308200 (+ 3507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.308203 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.308206 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.308436 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.308788 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:17.308792 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:17.308794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:17.308914 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:17.309661 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:17.309664 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:17.309946 (+ 282us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.310064 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.310250 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":989,"mutex_wait_us":948,"thread_start_us":182,"threads_started":1}
I20260810 01:37:17.310619 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.284351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:50073 (local address 127.24.205.189:36963)
0810 01:37:17.284784 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.284789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.286020 (+ 1231us) server_negotiation.cc:407] Connection header received
0810 01:37:17.288204 (+ 2184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.288209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.288261 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.288340 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.290589 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.291378 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.296879 (+ 5501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.297244 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.297332 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.305108 (+ 7776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.305117 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.305120 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.305147 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.307941 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.308575 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.308578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.308579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.308668 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.309053 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.309056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.309058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.309262 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.309364 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.310290 (+ 926us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.310411 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":297}
I20260810 01:37:17.310570 4428 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41855
I20260810 01:37:17.310912 4428 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:17.311131 4428 heartbeater.cc:511] Master 127.24.205.190:41855 requested a full tablet report, sending...
I20260810 01:37:17.311477 4430 heartbeater.cc:347] Connected to a master server at 127.24.205.189:36963
I20260810 01:37:17.311563 4430 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:17.311712 4430 heartbeater.cc:511] Master 127.24.205.189:36963 requested a full tablet report, sending...
I20260810 01:37:17.312098 3353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: NON_VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: true } } }
I20260810 01:37:17.312217 3353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:17.312482 2498 ts_manager.cc:194] Re-registered known tserver with Master: f77a5a1257de4dda807343710353bef3 (127.24.205.131:40561)
I20260810 01:37:17.313223 2498 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:54827
I20260810 01:37:17.315203 3423 ts_manager.cc:194] Registered new tserver with Master: f77a5a1257de4dda807343710353bef3 (127.24.205.131:40561)
I20260810 01:37:17.318481 4454 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: attempting to promote NON_VOTER c03da910113948c991105b0a7be65c51 to VOTER
I20260810 01:37:17.318890 4454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } }
I20260810 01:37:17.320276 3437 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Refusing update from remote peer 97f6d350e4ba43698a548322594c6019: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 01:37:17.320320 3734 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 LEARNER]: Refusing update from remote peer 97f6d350e4ba43698a548322594c6019: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 01:37:17.320659 4455 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:37:17.320825 4454 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:37:17.322593 4455 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, c03da910113948c991105b0a7be65c51 (127.24.205.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.323043 3437 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, c03da910113948c991105b0a7be65c51 (127.24.205.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.324136 4455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.324245 4455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:17.324800 4455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.324893 4455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:17.325033 3734 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, c03da910113948c991105b0a7be65c51 (127.24.205.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.327437 4454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.327649 4454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:17.327620 3778 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.327747 3778 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:37:17.324563 4471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97f6d350e4ba43698a548322594c6019" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:17.328195 4471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:37:17.333961 4474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.326527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:33801 (local address 127.0.0.1:35170)
0810 01:37:17.328472 (+ 1945us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.328488 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.328714 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.329629 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.329632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.329653 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:17.329758 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.329763 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.331206 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.331210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.332033 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.332043 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.333517 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.333521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.333620 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.333645 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.333718 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.333799 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1880,"mutex_wait_us":1,"thread_start_us":106,"threads_started":1}
I20260810 01:37:17.334131 4477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.326477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39674 (local address 127.24.205.130:36081)
0810 01:37:17.328985 (+ 2508us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.328997 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.329017 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:37:17.329082 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.329086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.329274 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.329600 (+ 326us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:17.330050 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.331183 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.332699 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.333505 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.333628 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.333781 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.333869 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.333963 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2397,"thread_start_us":264,"threads_started":1}
I20260810 01:37:17.334859 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.326838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35170 (local address 127.24.205.129:33801)
0810 01:37:17.328895 (+ 2057us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.328915 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.328941 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:37:17.329031 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.329038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.329299 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.329600 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:17.329894 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.331076 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.332363 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.333157 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.333293 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.333438 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.334667 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.334749 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1935,"thread_start_us":78,"threads_started":1}
I20260810 01:37:17.335047 4473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.325800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57120 (local address 127.24.205.131:40561)
0810 01:37:17.329964 (+ 4164us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.329986 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.330011 (+ 25us) server_negotiation.cc:407] Connection header received
0810 01:37:17.330088 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.330093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.330301 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.330853 (+ 552us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:17.330986 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.332162 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.333279 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.333985 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.334582 (+ 597us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.334718 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.334774 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.334866 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4045,"thread_start_us":270,"threads_started":1}
I20260810 01:37:17.334122 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.326040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36081 (local address 127.0.0.1:39674)
0810 01:37:17.326804 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.326819 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.327030 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.329868 (+ 2838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.329870 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.329880 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:17.329934 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.329937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.331320 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.331323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.332556 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.332566 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.333642 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.333646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.333734 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.333761 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.333839 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.333909 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":116,"threads_started":1}
I20260810 01:37:17.334446 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.325644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40561 (local address 127.0.0.1:57120)
0810 01:37:17.325765 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.325784 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.325881 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.330596 (+ 4715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.330599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.330618 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:17.330705 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.330710 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.332297 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.332301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.333150 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.333160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.334119 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.334123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.334221 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.334248 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.334301 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.334372 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 01:37:17.338296 4322 tablet_service.cc:1467] Processing CreateTablet for tablet 5a9add1693764b148853e304fcb4f49c (DEFAULT_TABLE table=test-table [id=da5df3430d234c86937518c58494657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:17.338209 3896 tablet_service.cc:1467] Processing CreateTablet for tablet 5a9add1693764b148853e304fcb4f49c (DEFAULT_TABLE table=test-table [id=da5df3430d234c86937518c58494657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:17.338629 4114 tablet_service.cc:1467] Processing CreateTablet for tablet 5a9add1693764b148853e304fcb4f49c (DEFAULT_TABLE table=test-table [id=da5df3430d234c86937518c58494657a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:17.339198 4322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a9add1693764b148853e304fcb4f49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:17.339325 3896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a9add1693764b148853e304fcb4f49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:17.339514 4114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a9add1693764b148853e304fcb4f49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:17.348841 4479 tablet_bootstrap.cc:492] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Bootstrap starting.
I20260810 01:37:17.351033 4479 tablet_bootstrap.cc:654] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:17.351902 4479 log.cc:824] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:17.352880 4481 tablet_bootstrap.cc:492] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Bootstrap starting.
I20260810 01:37:17.354866 4481 tablet_bootstrap.cc:654] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:17.355567 4481 log.cc:824] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:17.355717 4483 tablet_bootstrap.cc:492] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Bootstrap starting.
I20260810 01:37:17.357488 4479 tablet_bootstrap.cc:492] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: No bootstrap required, opened a new log
I20260810 01:37:17.357672 4483 tablet_bootstrap.cc:654] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:17.357722 4479 ts_tablet_manager.cc:1397] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260810 01:37:17.357829 4481 tablet_bootstrap.cc:492] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: No bootstrap required, opened a new log
I20260810 01:37:17.358004 4481 ts_tablet_manager.cc:1397] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260810 01:37:17.358462 4483 log.cc:824] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:17.360447 4483 tablet_bootstrap.cc:492] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: No bootstrap required, opened a new log
I20260810 01:37:17.360654 4483 ts_tablet_manager.cc:1397] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:37:17.362779 4479 raft_consensus.cc:348] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.362779 4481 raft_consensus.cc:348] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.363063 4479 raft_consensus.cc:374] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:17.363063 4481 raft_consensus.cc:374] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:17.363126 4481 raft_consensus.cc:729] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97da4630f90448bc98095cff5d9b8d03, State: Initialized, Role: FOLLOWER
I20260810 01:37:17.363126 4479 raft_consensus.cc:729] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5e06cc928c45fbab028012f64ca4e0, State: Initialized, Role: FOLLOWER
I20260810 01:37:17.363608 4479 consensus_queue.cc:260] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.363608 4481 consensus_queue.cc:260] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.364442 4223 heartbeater.cc:503] Master 127.24.205.190:41855 was elected leader, sending a full tablet report...
I20260810 01:37:17.364743 4481 ts_tablet_manager.cc:1428] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260810 01:37:17.364743 4479 ts_tablet_manager.cc:1428] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 01:37:17.365486 4003 heartbeater.cc:503] Master 127.24.205.190:41855 was elected leader, sending a full tablet report...
I20260810 01:37:17.364244 4483 raft_consensus.cc:348] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.368384 4483 raft_consensus.cc:374] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:17.368455 4483 raft_consensus.cc:729] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f77a5a1257de4dda807343710353bef3, State: Initialized, Role: FOLLOWER
I20260810 01:37:17.369156 4483 consensus_queue.cc:260] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.369920 4428 heartbeater.cc:503] Master 127.24.205.190:41855 was elected leader, sending a full tablet report...
I20260810 01:37:17.370433 4483 ts_tablet_manager.cc:1428] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
W20260810 01:37:17.537248 4431 tablet.cc:2369] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:17.554761 4227 tablet.cc:2369] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:17.594462 4005 tablet.cc:2369] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:37:17.603828 4491 raft_consensus.cc:482] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:17.604033 4491 raft_consensus.cc:504] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.605281 4491 leader_election.cc:288] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130:36081), 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:17.609125 4477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.605589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:51935 (local address 127.24.205.130:36081)
0810 01:37:17.605705 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.605711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.605799 (+ 88us) server_negotiation.cc:407] Connection header received
0810 01:37:17.605975 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.605977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.606020 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.606107 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:17.606473 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.606967 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.608167 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.608548 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.608677 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.608732 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.608926 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.608996 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:37:17.609167 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.605482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36081 (local address 127.24.205.131:51935)
0810 01:37:17.605705 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.605721 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.605842 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.606119 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.606121 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.606137 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:17.606343 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.606351 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.607084 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.607089 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.607997 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.608007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.608677 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.608681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.608792 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.608811 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.608905 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.608980 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":97,"spinlock_wait_cycles":3840}
I20260810 01:37:17.609185 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.605578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:33801 (local address 127.24.205.131:56959)
0810 01:37:17.605774 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:17.605790 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:17.605899 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:17.606170 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:17.606173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:17.606200 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:17.606345 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.606352 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.607083 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.607089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.608008 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:17.608018 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.608736 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.608740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:17.608858 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.608876 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:37:17.608970 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 01:37:17.609042 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":71,"spinlock_wait_cycles":1408}
I20260810 01:37:17.609184 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.605661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:56959 (local address 127.24.205.129:33801)
0810 01:37:17.605776 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.605782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.605868 (+ 86us) server_negotiation.cc:407] Connection header received
0810 01:37:17.606031 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.606033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.606074 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.606160 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:17.606464 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.606968 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.608176 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.608574 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.608708 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.608760 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.608988 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.609056 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:37:17.609871 3929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9add1693764b148853e304fcb4f49c" candidate_uuid: "f77a5a1257de4dda807343710353bef3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97da4630f90448bc98095cff5d9b8d03" is_pre_election: true
I20260810 01:37:17.609872 4140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9add1693764b148853e304fcb4f49c" candidate_uuid: "f77a5a1257de4dda807343710353bef3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5e06cc928c45fbab028012f64ca4e0" is_pre_election: true
I20260810 01:37:17.610205 4140 raft_consensus.cc:2454] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f77a5a1257de4dda807343710353bef3 in term 0.
I20260810 01:37:17.610224 3929 raft_consensus.cc:2454] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f77a5a1257de4dda807343710353bef3 in term 0.
I20260810 01:37:17.610754 4255 leader_election.cc:302] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5e06cc928c45fbab028012f64ca4e0, f77a5a1257de4dda807343710353bef3; no voters:
I20260810 01:37:17.611068 4491 raft_consensus.cc:2781] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:17.611163 4491 raft_consensus.cc:482] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:17.611218 4491 raft_consensus.cc:3037] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:17.612380 4491 raft_consensus.cc:504] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.612792 4491 leader_election.cc:288] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [CANDIDATE]: Term 1 election: Requested vote from peers 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130:36081), 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:17.613130 4140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9add1693764b148853e304fcb4f49c" candidate_uuid: "f77a5a1257de4dda807343710353bef3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5e06cc928c45fbab028012f64ca4e0"
I20260810 01:37:17.613226 3929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9add1693764b148853e304fcb4f49c" candidate_uuid: "f77a5a1257de4dda807343710353bef3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97da4630f90448bc98095cff5d9b8d03"
I20260810 01:37:17.613303 4140 raft_consensus.cc:3037] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:17.613371 3929 raft_consensus.cc:3037] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:17.614297 4140 raft_consensus.cc:2454] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77a5a1257de4dda807343710353bef3 in term 1.
I20260810 01:37:17.614660 4255 leader_election.cc:302] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5e06cc928c45fbab028012f64ca4e0, f77a5a1257de4dda807343710353bef3; no voters:
I20260810 01:37:17.614804 3929 raft_consensus.cc:2454] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77a5a1257de4dda807343710353bef3 in term 1.
I20260810 01:37:17.614820 4491 raft_consensus.cc:2781] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:17.615041 4491 raft_consensus.cc:686] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 1 LEADER]: Becoming Leader. State: Replica: f77a5a1257de4dda807343710353bef3, State: Running, Role: LEADER
I20260810 01:37:17.615401 4491 consensus_queue.cc:237] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } }
I20260810 01:37:17.618916 2496 catalog_manager.cc:5495] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f77a5a1257de4dda807343710353bef3 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "f77a5a1257de4dda807343710353bef3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } health_report { overall_health: UNKNOWN } } }
I20260810 01:37:17.693514 4473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.690209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57122 (local address 127.24.205.131:40561)
0810 01:37:17.690349 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.690352 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.690366 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:37:17.690445 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.690447 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.690501 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.690592 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:17.690815 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.691330 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.692192 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.692404 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.692482 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.692752 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:17.693185 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:17.693280 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.693335 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.693387 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:37:17.699432 4140 raft_consensus.cc:1261] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 FOLLOWER]: Refusing update from remote peer f77a5a1257de4dda807343710353bef3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:17.699433 3929 raft_consensus.cc:1261] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 1 FOLLOWER]: Refusing update from remote peer f77a5a1257de4dda807343710353bef3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:17.700274 4491 consensus_queue.cc:1035] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:17.700567 4492 consensus_queue.cc:1035] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:17.719918 2498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:17.720129 2498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:17.724421 2498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97f6d350e4ba43698a548322594c6019: Sending DeleteTablet for 3 replicas of tablet 5a9add1693764b148853e304fcb4f49c
I20260810 01:37:17.725531 3896 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a9add1693764b148853e304fcb4f49c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:17 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:35170
I20260810 01:37:17.725575 4114 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a9add1693764b148853e304fcb4f49c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:17 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:39674
I20260810 01:37:17.726198 4322 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a9add1693764b148853e304fcb4f49c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:17 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:57120
I20260810 01:37:17.727057 4508 tablet_replica.cc:330] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: stopping tablet replica
I20260810 01:37:17.727429 4508 raft_consensus.cc:2229] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:17.727800 4508 raft_consensus.cc:2258] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:17.728252 4512 tablet_replica.cc:330] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: stopping tablet replica
I20260810 01:37:17.728617 4512 raft_consensus.cc:2229] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:17.728920 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 2449
I20260810 01:37:17.734735 4508 ts_tablet_manager.cc:1905] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:17.745136 4512 raft_consensus.cc:2258] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:17.745731 4510 tablet_replica.cc:330] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: stopping tablet replica
I20260810 01:37:17.746197 4510 raft_consensus.cc:2229] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:17.746613 4510 raft_consensus.cc:2258] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:17.748560 4512 ts_tablet_manager.cc:1905] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:17.751451 4510 ts_tablet_manager.cc:1905] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:17.754634 4508 ts_tablet_manager.cc:1918] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:17.754752 4508 log.cc:1196] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/5a9add1693764b148853e304fcb4f49c
I20260810 01:37:17.755105 4508 ts_tablet_manager.cc:1939] T 5a9add1693764b148853e304fcb4f49c P 0c5e06cc928c45fbab028012f64ca4e0: Deleting consensus metadata
W20260810 01:37:17.756314 4042 connection.cc:441] server connection from 127.0.0.1:39674 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39674 (request call id 1) could send its response
I20260810 01:37:17.756717 4512 ts_tablet_manager.cc:1918] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:17.756907 4512 log.cc:1196] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/5a9add1693764b148853e304fcb4f49c
I20260810 01:37:17.757386 4512 ts_tablet_manager.cc:1939] T 5a9add1693764b148853e304fcb4f49c P f77a5a1257de4dda807343710353bef3: Deleting consensus metadata
I20260810 01:37:17.758477 4510 ts_tablet_manager.cc:1918] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:17.759799 4510 log.cc:1196] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/5a9add1693764b148853e304fcb4f49c
I20260810 01:37:17.760315 4510 ts_tablet_manager.cc:1939] T 5a9add1693764b148853e304fcb4f49c P 97da4630f90448bc98095cff5d9b8d03: Deleting consensus metadata
W20260810 01:37:17.760485 4257 connection.cc:441] server connection from 127.0.0.1:57120 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57120 (request call id 1) could send its response
W20260810 01:37:17.761595 3823 connection.cc:441] server connection from 127.0.0.1:35170 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35170 (request call id 1) could send its response
I20260810 01:37:17.770011 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.727079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33280 (local address 127.24.205.189:36963)
0810 01:37:17.727207 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.727212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.728289 (+ 1077us) server_negotiation.cc:407] Connection header received
0810 01:37:17.728635 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.728640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.728697 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.728753 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.750451 (+ 21698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.751367 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.759856 (+ 8489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.760257 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.760334 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.765779 (+ 5445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.765783 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.765786 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.765815 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.768120 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.768635 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.768639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.768641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.768731 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.769025 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.769028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.769029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.769253 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.769362 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.769722 (+ 360us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.769844 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:37:17.770758 4443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.756033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33282 (local address 127.24.205.189:36963)
0810 01:37:17.756168 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.756172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.757947 (+ 1775us) server_negotiation.cc:407] Connection header received
0810 01:37:17.758144 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.758147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.758203 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.758264 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.759842 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.760679 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.761914 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.762267 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.762346 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.766824 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.766829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.766833 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.766866 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.768707 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.769251 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.769254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.769256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.769344 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.769746 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.769750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.769752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.769983 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.770079 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.770454 (+ 375us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.770592 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55,"spinlock_wait_cycles":1408}
I20260810 01:37:17.771880 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.756872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48636 (local address 127.24.205.188:33445)
0810 01:37:17.757003 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.757007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.762047 (+ 5040us) server_negotiation.cc:407] Connection header received
0810 01:37:17.762207 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.762211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.762287 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.762344 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.763333 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.763854 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.764987 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.765415 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.765497 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.767232 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.767236 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.767239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.767272 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.769344 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.769851 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.769855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.769857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.769937 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.770563 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.770567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.770569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.770789 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.770901 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.771590 (+ 689us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.771714 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:37:17.779451 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:17.727548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48632 (local address 127.24.205.188:33445)
0810 01:37:17.727651 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:17.727655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:17.771460 (+ 43805us) server_negotiation.cc:407] Connection header received
0810 01:37:17.771628 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:17.771632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:17.771683 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:17.771732 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:17.772695 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.773360 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.774167 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:17.774427 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:17.774539 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:17.775920 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:17.775924 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:17.775927 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:17.775953 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:17.777606 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.778250 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.778254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.778255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.778355 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:17.778639 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:17.778641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:17.778642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:17.778811 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:17.778910 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:17.779156 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 01:37:17.779274 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:37:18.715914 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:18.715459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.131:60833)
0810 01:37:18.715727 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:18.715818 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":103,"threads_started":1}
W20260810 01:37:18.716249 4428 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:41855 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
I20260810 01:37:18.718364 4524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:18.717920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.130:56151)
0810 01:37:18.718170 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:18.718268 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260810 01:37:18.718730 4525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:18.718306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.129:32801)
0810 01:37:18.718527 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:18.718618 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
W20260810 01:37:18.718807 4223 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:41855 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
W20260810 01:37:18.719018 4003 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:41855 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
I20260810 01:37:19.225196 4526 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97f6d350e4ba43698a548322594c6019)
I20260810 01:37:19.225349 4526 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } }
I20260810 01:37:19.226011 4526 leader_election.cc:288] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855), c03da910113948c991105b0a7be65c51 (127.24.205.188:33445)
I20260810 01:37:19.226745 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.226196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58766)
0810 01:37:19.226537 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.226625 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":56,"threads_started":1}
W20260810 01:37:19.227079 3395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
I20260810 01:37:19.227265 4527 raft_consensus.cc:482] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97f6d350e4ba43698a548322594c6019)
I20260810 01:37:19.227481 4527 raft_consensus.cc:504] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } }
I20260810 01:37:19.228012 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.227773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58770)
0810 01:37:19.227893 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.227946 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 01:37:19.228222 3395 leader_election.cc:334] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855): Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
I20260810 01:37:19.228766 4527 leader_election.cc:288] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855), 3844064d72ee48f386b193219e8da24e (127.24.205.189:36963)
I20260810 01:37:19.229300 4536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.228795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58774)
0810 01:37:19.229117 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.229198 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":85,"threads_started":1}
W20260810 01:37:19.229456 3692 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
I20260810 01:37:19.230412 4536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.230186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58776)
0810 01:37:19.230304 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.230359 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 01:37:19.230581 3692 leader_election.cc:334] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855): Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
I20260810 01:37:19.231333 4533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.226783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48652 (local address 127.24.205.188:33445)
0810 01:37:19.227139 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.227144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.227161 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:37:19.227213 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.227216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.227260 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.227360 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:19.227740 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.228525 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.230230 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.230863 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.230972 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.231057 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.231187 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.231248 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":273,"thread_start_us":99,"threads_started":1}
I20260810 01:37:19.231362 4532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.226397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33445 (local address 127.0.0.1:48652)
0810 01:37:19.226947 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.226964 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:19.227060 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:19.227468 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:19.227471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:19.227496 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:19.227615 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.227622 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.228648 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.228653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.230080 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.230094 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.230960 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.230964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.231057 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.231084 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:37:19.231167 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 01:37:19.231238 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":58,"threads_started":1}
I20260810 01:37:19.231954 3734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3844064d72ee48f386b193219e8da24e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c03da910113948c991105b0a7be65c51" is_pre_election: true
I20260810 01:37:19.232210 3734 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3844064d72ee48f386b193219e8da24e in term 1.
I20260810 01:37:19.232534 3399 leader_election.cc:302] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3844064d72ee48f386b193219e8da24e, c03da910113948c991105b0a7be65c51; no voters: 97f6d350e4ba43698a548322594c6019
I20260810 01:37:19.232705 4526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 01:37:19.232767 4526 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 97f6d350e4ba43698a548322594c6019)
I20260810 01:37:19.232823 4526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:37:19.233314 4538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.229178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33286 (local address 127.24.205.189:36963)
0810 01:37:19.229459 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.229470 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.229486 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:37:19.229541 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.229543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.229585 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.229673 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:19.229993 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.230782 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.232182 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.232766 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.232910 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.232954 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.233167 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.233223 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":101,"threads_started":1}
I20260810 01:37:19.233336 4537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.228938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36963 (local address 127.0.0.1:33286)
0810 01:37:19.229180 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.229196 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:19.229292 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:19.229754 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:19.229758 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:19.229778 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:19.229870 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.229876 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.230884 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.230888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.232009 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.232018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.232894 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.232898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.233022 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.233064 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 01:37:19.233153 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 01:37:19.233224 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":1,"thread_start_us":56,"threads_started":1}
I20260810 01:37:19.233762 3437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c03da910113948c991105b0a7be65c51" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3844064d72ee48f386b193219e8da24e" is_pre_election: true
I20260810 01:37:19.234177 4526 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } }
I20260810 01:37:19.234427 3437 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c03da910113948c991105b0a7be65c51 in current term 2: Already voted for candidate 3844064d72ee48f386b193219e8da24e in this term.
I20260810 01:37:19.234555 4526 leader_election.cc:288] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 2 election: Requested vote from peers 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855), c03da910113948c991105b0a7be65c51 (127.24.205.188:33445)
I20260810 01:37:19.234825 4532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.234637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58788)
0810 01:37:19.234721 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.234771 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260810 01:37:19.234835 3734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3844064d72ee48f386b193219e8da24e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c03da910113948c991105b0a7be65c51"
I20260810 01:37:19.234891 3694 leader_election.cc:302] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c03da910113948c991105b0a7be65c51; no voters: 3844064d72ee48f386b193219e8da24e, 97f6d350e4ba43698a548322594c6019
I20260810 01:37:19.234956 3734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:37:19.235460 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.235234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58796)
0810 01:37:19.235354 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.235404 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 01:37:19.235584 3395 leader_election.cc:334] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855): Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
I20260810 01:37:19.236115 3734 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3844064d72ee48f386b193219e8da24e in term 2.
I20260810 01:37:19.236223 4527 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:37:19.236423 3399 leader_election.cc:302] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3844064d72ee48f386b193219e8da24e, c03da910113948c991105b0a7be65c51; no voters: 97f6d350e4ba43698a548322594c6019
I20260810 01:37:19.236642 4526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:37:19.236820 4526 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [term 2 LEADER]: Becoming Leader. State: Replica: 3844064d72ee48f386b193219e8da24e, State: Running, Role: LEADER
I20260810 01:37:19.237063 4526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } }
I20260810 01:37:19.238054 4541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3844064d72ee48f386b193219e8da24e. Latest consensus state: current_term: 2 leader_uuid: "3844064d72ee48f386b193219e8da24e" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:19.238191 4541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:19.238511 4544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:19.241024 4544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:19.241425 4544 catalog_manager.cc:1259] Loaded cluster ID: 506ea438ae0844cbb5c7e9b10d96c4c0
I20260810 01:37:19.241472 4544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:19.242012 4544 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:19.242415 4544 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Loaded TSK: 0
I20260810 01:37:19.243081 4544 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:37:19.284121 3421 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33282:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:37:19.287276 3421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:19.290448 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.290188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58822)
0810 01:37:19.290324 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.290384 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 01:37:19.290460 3734 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [term 2 FOLLOWER]: Refusing update from remote peer 3844064d72ee48f386b193219e8da24e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260810 01:37:19.290938 4541 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 01:37:19.291224 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.290991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.0.0.1:58836)
0810 01:37:19.291125 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.291169 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 01:37:19.291342 3395 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e -> Peer 97f6d350e4ba43698a548322594c6019 (127.24.205.190:41855): Couldn't send request to peer 97f6d350e4ba43698a548322594c6019. Status: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:37:19.292569 4527 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3844064d72ee48f386b193219e8da24e. Latest consensus state: current_term: 2 leader_uuid: "3844064d72ee48f386b193219e8da24e" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:19.292712 4527 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:37:19.293764 4541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3844064d72ee48f386b193219e8da24e" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:19.294026 4541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:19.294159 4527 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3844064d72ee48f386b193219e8da24e" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "97f6d350e4ba43698a548322594c6019" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41855 } } peers { permanent_uuid: "3844064d72ee48f386b193219e8da24e" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36963 } attrs { promote: false } } peers { permanent_uuid: "c03da910113948c991105b0a7be65c51" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33445 } attrs { promote: false } } }
I20260810 01:37:19.294291 4527 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03da910113948c991105b0a7be65c51 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:37:19.304807 4558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.300369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40561 (local address 127.0.0.1:57136)
0810 01:37:19.300827 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.300841 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:19.300922 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:19.301441 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:19.301444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:19.301472 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:19.301570 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.301575 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.302530 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.302535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.303487 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.303497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.304332 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.304336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.304431 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.304454 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:37:19.304532 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:37:19.304627 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":5,"spinlock_wait_cycles":768,"thread_start_us":91,"threads_started":1}
I20260810 01:37:19.305007 4532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.300293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36081 (local address 127.0.0.1:39676)
0810 01:37:19.300617 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.300631 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:19.300708 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:19.301420 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:19.301422 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:19.301441 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:19.301529 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.301535 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.302303 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.302308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.303597 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.303608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.304542 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.304545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.304681 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.304704 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:37:19.304790 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 01:37:19.304873 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":124,"spinlock_wait_cycles":3328}
I20260810 01:37:19.305083 4559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.300621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39676 (local address 127.24.205.130:36081)
0810 01:37:19.301190 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.301195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.301207 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:37:19.301259 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.301264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.301316 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.301399 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:19.301657 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.302189 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.303747 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.304375 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.304531 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.304584 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.304824 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.304924 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":80,"threads_started":1}
I20260810 01:37:19.305289 4560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.300859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57136 (local address 127.24.205.131:40561)
0810 01:37:19.301098 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.301102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.301117 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:19.301171 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.301174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.301224 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.301310 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:19.301699 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.302437 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.303637 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.304206 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.304345 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.304402 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.305026 (+ 624us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.305129 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":87,"threads_started":1}
I20260810 01:37:19.305531 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.299988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:33801 (local address 127.0.0.1:35174)
0810 01:37:19.300499 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.300514 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:19.300609 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:19.301061 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:19.301064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:19.301077 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:19.301183 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.301189 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.302274 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.302277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.303608 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.303615 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.304516 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.304520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.305246 (+ 726us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.305270 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:37:19.305339 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:37:19.305411 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":677}
I20260810 01:37:19.305606 4114 tablet_service.cc:1467] Processing CreateTablet for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc (DEFAULT_TABLE table=test-table [id=96fd8fd910ce44e98e3525b8d5145411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:19.305835 4322 tablet_service.cc:1467] Processing CreateTablet for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc (DEFAULT_TABLE table=test-table [id=96fd8fd910ce44e98e3525b8d5145411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:19.305912 4114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:19.305995 4556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.300280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.24.205.129:33801)
0810 01:37:19.300839 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.300845 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.300862 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:37:19.300917 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.300920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.300975 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.301059 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:19.301313 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.302140 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.303747 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.304375 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.304670 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.304712 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.305781 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.305868 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":64,"threads_started":1}
I20260810 01:37:19.306129 4322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:19.306473 3896 tablet_service.cc:1467] Processing CreateTablet for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc (DEFAULT_TABLE table=test-table [id=96fd8fd910ce44e98e3525b8d5145411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:19.306730 3896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:19.308475 4564 tablet_bootstrap.cc:492] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: Bootstrap starting.
I20260810 01:37:19.309238 4567 tablet_bootstrap.cc:492] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03: Bootstrap starting.
I20260810 01:37:19.309419 4564 tablet_bootstrap.cc:654] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:19.309877 4563 tablet_bootstrap.cc:492] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: Bootstrap starting.
I20260810 01:37:19.310334 4567 tablet_bootstrap.cc:654] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:19.310660 4564 tablet_bootstrap.cc:492] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: No bootstrap required, opened a new log
I20260810 01:37:19.310746 4564 ts_tablet_manager.cc:1397] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:19.310848 4563 tablet_bootstrap.cc:654] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:19.311245 4564 raft_consensus.cc:348] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.311385 4564 raft_consensus.cc:374] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:19.311429 4564 raft_consensus.cc:729] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5e06cc928c45fbab028012f64ca4e0, State: Initialized, Role: FOLLOWER
I20260810 01:37:19.311486 4567 tablet_bootstrap.cc:492] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03: No bootstrap required, opened a new log
I20260810 01:37:19.311581 4567 ts_tablet_manager.cc:1397] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:19.311571 4564 consensus_queue.cc:260] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.311925 4564 ts_tablet_manager.cc:1428] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:19.311968 4563 tablet_bootstrap.cc:492] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: No bootstrap required, opened a new log
I20260810 01:37:19.312086 4563 ts_tablet_manager.cc:1397] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:19.312474 4563 raft_consensus.cc:348] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.312629 4563 raft_consensus.cc:374] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:19.312680 4563 raft_consensus.cc:729] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f77a5a1257de4dda807343710353bef3, State: Initialized, Role: FOLLOWER
I20260810 01:37:19.312691 4567 raft_consensus.cc:348] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.312819 4567 raft_consensus.cc:374] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:19.312805 4563 consensus_queue.cc:260] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.312857 4567 raft_consensus.cc:729] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97da4630f90448bc98095cff5d9b8d03, State: Initialized, Role: FOLLOWER
I20260810 01:37:19.313030 4567 consensus_queue.cc:260] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.313158 4563 ts_tablet_manager.cc:1428] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:19.313544 4567 ts_tablet_manager.cc:1428] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:19.314277 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.313682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.129:34087)
0810 01:37:19.314096 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.314157 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":100,"threads_started":1}
I20260810 01:37:19.315387 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.314680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.129:48051)
0810 01:37:19.315247 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.315303 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":101,"threads_started":1}
I20260810 01:37:19.316792 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.314117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.131:43043)
0810 01:37:19.316643 (+ 2526us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.316701 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2453,"thread_start_us":109,"threads_started":1}
I20260810 01:37:19.317076 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.316304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.130:51283)
0810 01:37:19.316936 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.316991 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":90,"threads_started":1}
I20260810 01:37:19.317622 4226 heartbeater.cc:503] Master 127.24.205.189:36963 was elected leader, sending a full tablet report...
I20260810 01:37:19.555783 4573 raft_consensus.cc:482] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:19.555984 4573 raft_consensus.cc:504] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.557313 4573 leader_election.cc:288] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f77a5a1257de4dda807343710353bef3 (127.24.205.131:40561), 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:19.562075 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.557611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40561 (local address 127.24.205.130:33203)
0810 01:37:19.557754 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.557775 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:19.557898 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:19.558126 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:19.558128 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:19.558142 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:19.558277 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.558283 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.559288 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.559290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.560668 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.560680 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.561630 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.561632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.561716 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.561737 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:37:19.561838 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 01:37:19.561913 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 01:37:19.562104 4560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.557738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:33203 (local address 127.24.205.131:40561)
0810 01:37:19.557888 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.557893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.557913 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:37:19.557984 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.557986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.558029 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.558098 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:19.558397 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.559145 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.560848 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.561487 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.561617 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.561671 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.561881 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.561962 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 01:37:19.562237 4556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.557736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:39941 (local address 127.24.205.129:33801)
0810 01:37:19.557898 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.557904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.558588 (+ 684us) server_negotiation.cc:407] Connection header received
0810 01:37:19.558652 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.558655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.558701 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.558781 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:19.559014 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.559638 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.561093 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.561686 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.561792 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.561864 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.562039 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.562106 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 01:37:19.562245 4587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.557611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:33801 (local address 127.24.205.130:39941)
0810 01:37:19.558489 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.558501 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:19.558588 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:19.558799 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:19.558801 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:19.558814 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:19.558907 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.558912 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.559759 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.559763 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.560950 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:19.560957 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.561818 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.561824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:19.561915 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.561936 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:37:19.562007 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 01:37:19.562062 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":554,"thread_start_us":162,"threads_started":1}
I20260810 01:37:19.562633 4356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd77b5dd8a649d9b3724fcc0823d4bc" candidate_uuid: "0c5e06cc928c45fbab028012f64ca4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77a5a1257de4dda807343710353bef3" is_pre_election: true
I20260810 01:37:19.562891 4356 raft_consensus.cc:2454] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5e06cc928c45fbab028012f64ca4e0 in term 0.
I20260810 01:37:19.563038 3929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd77b5dd8a649d9b3724fcc0823d4bc" candidate_uuid: "0c5e06cc928c45fbab028012f64ca4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97da4630f90448bc98095cff5d9b8d03" is_pre_election: true
I20260810 01:37:19.563189 3929 raft_consensus.cc:2454] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c5e06cc928c45fbab028012f64ca4e0 in term 0.
I20260810 01:37:19.563423 4039 leader_election.cc:302] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5e06cc928c45fbab028012f64ca4e0, f77a5a1257de4dda807343710353bef3; no voters:
I20260810 01:37:19.563709 4573 raft_consensus.cc:2781] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:19.563793 4573 raft_consensus.cc:482] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:19.563854 4573 raft_consensus.cc:3037] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:19.564947 4573 raft_consensus.cc:504] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.565343 4573 leader_election.cc:288] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [CANDIDATE]: Term 1 election: Requested vote from peers f77a5a1257de4dda807343710353bef3 (127.24.205.131:40561), 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801)
I20260810 01:37:19.565671 4356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd77b5dd8a649d9b3724fcc0823d4bc" candidate_uuid: "0c5e06cc928c45fbab028012f64ca4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77a5a1257de4dda807343710353bef3"
I20260810 01:37:19.565753 3929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd77b5dd8a649d9b3724fcc0823d4bc" candidate_uuid: "0c5e06cc928c45fbab028012f64ca4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97da4630f90448bc98095cff5d9b8d03"
I20260810 01:37:19.565819 4356 raft_consensus.cc:3037] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:19.565912 3929 raft_consensus.cc:3037] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:19.566787 4356 raft_consensus.cc:2454] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5e06cc928c45fbab028012f64ca4e0 in term 1.
I20260810 01:37:19.566865 3929 raft_consensus.cc:2454] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c5e06cc928c45fbab028012f64ca4e0 in term 1.
I20260810 01:37:19.567092 4039 leader_election.cc:302] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5e06cc928c45fbab028012f64ca4e0, f77a5a1257de4dda807343710353bef3; no voters:
I20260810 01:37:19.567282 4573 raft_consensus.cc:2781] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:19.567523 4573 raft_consensus.cc:686] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0c5e06cc928c45fbab028012f64ca4e0, State: Running, Role: LEADER
I20260810 01:37:19.567984 4573 consensus_queue.cc:237] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } }
I20260810 01:37:19.568358 4587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.568025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.130:37553)
0810 01:37:19.568204 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.568286 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 01:37:19.570600 3421 catalog_manager.cc:5495] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "0c5e06cc928c45fbab028012f64ca4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c5e06cc928c45fbab028012f64ca4e0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260810 01:37:19.598717 4559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.595262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52560 (local address 127.24.205.130:36081)
0810 01:37:19.595396 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:19.595399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:19.595411 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:37:19.595487 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:19.595489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:19.595543 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:19.595630 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:19.595865 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.596380 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.597349 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:19.597557 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:19.597633 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:19.597870 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:19.598289 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:19.598373 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:19.598486 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 01:37:19.598535 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:37:19.601440 3929 raft_consensus.cc:1261] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 97da4630f90448bc98095cff5d9b8d03 [term 1 FOLLOWER]: Refusing update from remote peer 0c5e06cc928c45fbab028012f64ca4e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:19.601779 4356 raft_consensus.cc:1261] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 1 FOLLOWER]: Refusing update from remote peer 0c5e06cc928c45fbab028012f64ca4e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:19.602034 4588 consensus_queue.cc:1035] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97da4630f90448bc98095cff5d9b8d03" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:19.602411 4573 consensus_queue.cc:1035] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f77a5a1257de4dda807343710353bef3" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:19.603183 4004 heartbeater.cc:503] Master 127.24.205.189:36963 was elected leader, sending a full tablet report...
I20260810 01:37:19.603756 4584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.603427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.129:50291)
0810 01:37:19.603581 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.603642 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260810 01:37:19.604141 4430 heartbeater.cc:503] Master 127.24.205.189:36963 was elected leader, sending a full tablet report...
I20260810 01:37:19.604955 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.604514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.131:60471)
0810 01:37:19.604822 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.604882 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241}
I20260810 01:37:19.606588 4594 mvcc.cc:205] Tried to move back new op lower bound from 7316790639002640384 to 7316790638873632768. Current Snapshot: MvccSnapshot[applied={T|T < 7316790639002640384}]
I20260810 01:37:19.607497 4599 mvcc.cc:205] Tried to move back new op lower bound from 7316790639002640384 to 7316790638873632768. Current Snapshot: MvccSnapshot[applied={T|T < 7316790639002640384}]
I20260810 01:37:19.607645 4587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.607354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.130:35007)
0810 01:37:19.607511 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.607569 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260810 01:37:19.608048 4595 mvcc.cc:205] Tried to move back new op lower bound from 7316790639002640384 to 7316790638873632768. Current Snapshot: MvccSnapshot[applied={T|T < 7316790639002640384}]
I20260810 01:37:19.608873 4584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.608606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.129:34563)
0810 01:37:19.608759 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.608808 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260810 01:37:19.609256 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.608362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41855 (local address 127.24.205.131:45313)
0810 01:37:19.609126 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.609181 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":694}
I20260810 01:37:19.616999 3423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:19.617163 3423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:19.620995 3423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3844064d72ee48f386b193219e8da24e: Sending DeleteTablet for 3 replicas of tablet 3fd77b5dd8a649d9b3724fcc0823d4bc
I20260810 01:37:19.621779 4114 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:19 UTC) from {username='oryx', principal='oryx/127.24.205.189@KRBTEST.COM'} at 127.0.0.1:39676
I20260810 01:37:19.622119 4609 tablet_replica.cc:330] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: stopping tablet replica
I20260810 01:37:19.622313 4609 raft_consensus.cc:2229] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:19.622443 3896 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:19 UTC) from {username='oryx', principal='oryx/127.24.205.189@KRBTEST.COM'} at 127.0.0.1:35174
I20260810 01:37:19.622499 4322 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:19 UTC) from {username='oryx', principal='oryx/127.24.205.189@KRBTEST.COM'} at 127.0.0.1:57136
I20260810 01:37:19.622761 4609 raft_consensus.cc:2258] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:19.623346 4613 tablet_replica.cc:330] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: stopping tablet replica
I20260810 01:37:19.623334 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 3657
I20260810 01:37:19.623725 4609 ts_tablet_manager.cc:1905] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:19.626617 4609 ts_tablet_manager.cc:1918] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:19.626776 4609 log.cc:1196] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/3fd77b5dd8a649d9b3724fcc0823d4bc
I20260810 01:37:19.627126 4609 ts_tablet_manager.cc:1939] T 3fd77b5dd8a649d9b3724fcc0823d4bc P 0c5e06cc928c45fbab028012f64ca4e0: Deleting consensus metadata
I20260810 01:37:19.630810 4613 raft_consensus.cc:2229] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:19.630856 3395 catalog_manager.cc:4841] TS 0c5e06cc928c45fbab028012f64ca4e0 (127.24.205.130:36081): tablet 3fd77b5dd8a649d9b3724fcc0823d4bc (table test-table [id=96fd8fd910ce44e98e3525b8d5145411]) successfully deleted
I20260810 01:37:19.630977 4613 raft_consensus.cc:2258] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:19.632009 4613 ts_tablet_manager.cc:1905] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:19.634244 4613 ts_tablet_manager.cc:1918] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:19.634347 4613 log.cc:1196] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/3fd77b5dd8a649d9b3724fcc0823d4bc
I20260810 01:37:19.634684 4613 ts_tablet_manager.cc:1939] T 3fd77b5dd8a649d9b3724fcc0823d4bc P f77a5a1257de4dda807343710353bef3: Deleting consensus metadata
I20260810 01:37:19.635319 3399 catalog_manager.cc:4841] TS f77a5a1257de4dda807343710353bef3 (127.24.205.131:40561): tablet 3fd77b5dd8a649d9b3724fcc0823d4bc (table test-table [id=96fd8fd910ce44e98e3525b8d5145411]) successfully deleted
I20260810 01:37:19.641042 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 4013
I20260810 01:37:19.641251 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:19.640954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:33801 (local address 127.0.0.1:36962)
0810 01:37:19.641114 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:19.641176 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:33801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260810 01:37:19.644272 3402 catalog_manager.cc:4584] TS 97da4630f90448bc98095cff5d9b8d03 (127.24.205.129:33801): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3fd77b5dd8a649d9b3724fcc0823d4bc: Network error: Client connection negotiation failed: client connection to 127.24.205.129:33801: connect: Connection refused (error 111)
I20260810 01:37:19.659953 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 4231
I20260810 01:37:19.671936 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 3212
I20260810 01:37:19.686344 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 3378
2026-08-10T01:37:19Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6107 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:19 dist-test-slave-t3q3 krb5kdc[4618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:19 dist-test-slave-t3q3 krb5kdc[4618](info): set up 2 sockets
Aug 10 01:37:19 dist-test-slave-t3q3 krb5kdc[4618](info): commencing operation
krb5kdc: starting...
W20260810 01:37:20.957000 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:21Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab.
Entry for principal oryx/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab.
I20260810 01:37:21.091105 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44699
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab
--principal=oryx/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:44699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:21.208171 4639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:21.208474 4639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:21.208559 4639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:21.212504 4639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:21.212596 4639 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 01:37:21.212630 4639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:21.212669 4639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:21.212705 4639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:21.212742 4639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:21.217888 4639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:44699
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.190.keytab
--principal=oryx/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:21.218997 4639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:21.220134 4639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:21.228685 4645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:21.228801 4639 server_base.cc:1034] running on GCE node
W20260810 01:37:21.228675 4646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:21.228724 4649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:21.229457 4639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:21.230517 4639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:21.231709 4639 hybrid_clock.cc:648] HybridClock initialized: now 1786325841231695 us; error 36 us; skew 500 ppm
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:21.234481 4639 init.cc:377] Logged in from keytab as oryx/127.24.205.190@KRBTEST.COM (short username oryx)
I20260810 01:37:21.235328 4639 webserver.cc:460] Webserver started at http://127.24.205.190:36221/ using document root <none> and password file <none>
I20260810 01:37:21.235826 4639 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:21.235883 4639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:21.236049 4639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:21.238077 4639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "c8858576b51e42f9bb51150cc70ad966"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "1e5d8729f7ed07eed43628d6e174afe1"
server_key_iv: "34eed0ac99900fcc675ae0cc23213f97"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.238583 4639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "c8858576b51e42f9bb51150cc70ad966"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "1e5d8729f7ed07eed43628d6e174afe1"
server_key_iv: "34eed0ac99900fcc675ae0cc23213f97"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.242221 4639 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260810 01:37:21.244541 4658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:21.245703 4639 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:21.245801 4639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "c8858576b51e42f9bb51150cc70ad966"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "1e5d8729f7ed07eed43628d6e174afe1"
server_key_iv: "34eed0ac99900fcc675ae0cc23213f97"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.245888 4639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:21.255836 4639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:21.258478 4639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:21.258620 4639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:21.266443 4639 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:44699
I20260810 01:37:21.266470 4749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:44699 every 8 connection(s)
I20260810 01:37:21.267325 4639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:21.268373 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 4639
I20260810 01:37:21.268523 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:21.268864 25398 external_mini_cluster.cc:1428] Setting key 3477ad03ddc72dc4fe1c02fccb5e85cb
I20260810 01:37:21.270556 4750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:21.276036 4750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Bootstrap starting.
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:21.278759 4750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:21.280040 4750 log.cc:824] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:21.282379 4750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: No bootstrap required, opened a new log
I20260810 01:37:21.283488 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.270288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46296 (local address 127.24.205.190:44699)
0810 01:37:21.270748 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:21.270764 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:21.270798 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:37:21.271421 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:21.271437 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:21.271760 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:21.272106 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:21.272925 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.273911 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.274805 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.275269 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.275437 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.278375 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:21.278380 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:21.278392 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:21.278417 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:21.280215 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.280788 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.280792 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.280797 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.280943 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.281243 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.281246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.281248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.281737 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:21.281930 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:21.282282 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 01:37:21.282578 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":128,"threads_started":1}
I20260810 01:37:21.285954 4750 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8858576b51e42f9bb51150cc70ad966" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44699 } }
I20260810 01:37:21.286161 4750 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:21.286198 4750 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8858576b51e42f9bb51150cc70ad966, State: Initialized, Role: FOLLOWER
I20260810 01:37:21.286592 4750 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8858576b51e42f9bb51150cc70ad966" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44699 } }
I20260810 01:37:21.286722 4750 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:21.286772 4750 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:21.286842 4750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:21.287827 4750 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8858576b51e42f9bb51150cc70ad966" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44699 } }
I20260810 01:37:21.288182 4750 leader_election.cc:302] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8858576b51e42f9bb51150cc70ad966; no voters:
I20260810 01:37:21.288451 4750 leader_election.cc:288] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:21.288664 4759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:21.288936 4759 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [term 1 LEADER]: Becoming Leader. State: Replica: c8858576b51e42f9bb51150cc70ad966, State: Running, Role: LEADER
I20260810 01:37:21.289239 4759 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8858576b51e42f9bb51150cc70ad966" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44699 } }
I20260810 01:37:21.289706 4750 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:21.290961 4760 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8858576b51e42f9bb51150cc70ad966" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8858576b51e42f9bb51150cc70ad966" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44699 } } }
I20260810 01:37:21.291093 4760 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:21.291536 4769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:21.291455 4761 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8858576b51e42f9bb51150cc70ad966. Latest consensus state: current_term: 1 leader_uuid: "c8858576b51e42f9bb51150cc70ad966" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8858576b51e42f9bb51150cc70ad966" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44699 } } }
I20260810 01:37:21.292187 4761 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:21.294389 4769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:21.299197 4769 catalog_manager.cc:1347] Generated new cluster ID: be460c0dd233403f862cf0b5b6ae21e0
I20260810 01:37:21.299260 4769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:21.311275 4769 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:21.312227 4769 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:21.318641 4769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Generated new TSK 0
I20260810 01:37:21.319267 4769 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab.
Entry for principal oryx/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab.
I20260810 01:37:21.349119 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44699
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab
--principal=oryx/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:21.468132 4791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:21.468394 4791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:21.468467 4791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:21.472765 4791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:21.472839 4791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:21.472885 4791 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:37:21.472947 4791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:21.478456 4791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab
--principal=oryx/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:21.479605 4791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:21.480764 4791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:21.490852 4798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:21.490844 4801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:21.490844 4799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:21.491194 4791 server_base.cc:1034] running on GCE node
I20260810 01:37:21.491678 4791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:21.492415 4791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:21.493618 4791 hybrid_clock.cc:648] HybridClock initialized: now 1786325841493600 us; error 38 us; skew 500 ppm
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:21.496646 4791 init.cc:377] Logged in from keytab as oryx/127.24.205.129@KRBTEST.COM (short username oryx)
I20260810 01:37:21.497543 4791 webserver.cc:460] Webserver started at http://127.24.205.129:35291/ using document root <none> and password file <none>
I20260810 01:37:21.498157 4791 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:21.498257 4791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:21.498497 4791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:21.500630 4791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "a4fc997bb1ba92c075dc23abacb3d3b9"
server_key_iv: "3c7ff4846ecec659eaf1ac0eed2a0f2e"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.501230 4791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "a4fc997bb1ba92c075dc23abacb3d3b9"
server_key_iv: "3c7ff4846ecec659eaf1ac0eed2a0f2e"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.505048 4791 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:37:21.507584 4813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:21.508817 4791 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:21.508955 4791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "a4fc997bb1ba92c075dc23abacb3d3b9"
server_key_iv: "3c7ff4846ecec659eaf1ac0eed2a0f2e"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.509068 4791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:21.551045 4791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:21.554229 4791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:21.554441 4791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:21.555917 4791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:21.555994 4791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:21.556094 4791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:21.556142 4791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:21.567495 4791 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:35151
I20260810 01:37:21.567591 4977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:35151 every 8 connection(s)
I20260810 01:37:21.568493 4791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:21.570207 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.556881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:51191 (local address 127.24.205.190:44699)
0810 01:37:21.557075 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:21.557080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:21.557904 (+ 824us) server_negotiation.cc:407] Connection header received
0810 01:37:21.559104 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:21.559107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:21.559169 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:21.559227 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:21.560956 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.561653 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.562815 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.563173 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.563292 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.566210 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:21.566214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:21.566217 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:21.566252 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:21.567977 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.568533 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.568537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.568539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.568636 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.569025 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.569028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.569030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.569263 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:21.569368 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:21.569906 (+ 538us) server_negotiation.cc:299] Negotiation successful
0810 01:37:21.570031 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260810 01:37:21.570977 4829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.557285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44699 (local address 127.24.205.129:51191)
0810 01:37:21.557735 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:21.557785 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:21.558838 (+ 1053us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:21.559717 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:21.559727 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:21.560135 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:21.560794 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.560811 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.561791 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.561795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.562680 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.562690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.563341 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.563345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.563540 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.564137 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:21.564162 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:21.566038 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:21.568143 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.568150 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.568163 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.568422 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.568731 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.568734 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.568736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.568881 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.569380 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:21.569387 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:21.569673 (+ 286us) client_negotiation.cc:769] Sending connection context
0810 01:37:21.569862 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 01:37:21.570162 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":131,"threads_started":1}
I20260810 01:37:21.572290 4978 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44699
I20260810 01:37:21.572448 4978 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:21.572960 4978 heartbeater.cc:511] Master 127.24.205.190:44699 requested a full tablet report, sending...
I20260810 01:37:21.574536 4682 ts_manager.cc:194] Registered new tserver with Master: 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151)
I20260810 01:37:21.575894 4682 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:51191
I20260810 01:37:21.577883 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 4791
I20260810 01:37:21.578022 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:21.578363 25398 external_mini_cluster.cc:1428] Setting key 8ed6b3519b90b8ea5ff609818699f993
I20260810 01:37:21.581591 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.574310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:45297 (local address 127.24.205.190:44699)
0810 01:37:21.574443 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:21.574447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:21.574667 (+ 220us) server_negotiation.cc:407] Connection header received
0810 01:37:21.574833 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:21.574835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:21.574874 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:21.574938 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:21.575418 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.575907 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.576885 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.577215 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.577322 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.578356 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:21.578360 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:21.578362 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:21.578385 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:21.579998 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.580445 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.580450 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.580451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.580534 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.580813 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.580817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.580819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.580982 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:21.581087 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:21.581338 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 01:37:21.581442 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":50}
I20260810 01:37:21.581600 4986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.574257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44699 (local address 127.24.205.129:45297)
0810 01:37:21.574573 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:21.574588 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:21.574734 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:21.574980 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:21.574983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:21.575183 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:21.575300 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.575307 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.576039 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.576043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.576770 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.576779 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.577337 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.577339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.577406 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.577905 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:21.577916 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:21.578215 (+ 299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:21.580139 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.580143 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.580148 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.580344 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.580635 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.580638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.580640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.580722 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.581080 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:21.581083 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:21.581177 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 01:37:21.581283 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 01:37:21.581417 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":1,"thread_start_us":136,"threads_started":1}
WARNING: no policy specified for oryx/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab.
Entry for principal oryx/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab.
I20260810 01:37:21.606411 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44699
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab
--principal=oryx/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:21.717801 4990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:21.718050 4990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:21.718092 4990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:21.722167 4990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:21.722222 4990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:21.722261 4990 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:37:21.722293 4990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:21.727280 4990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab
--principal=oryx/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:21.728225 4990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:21.729288 4990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:21.739040 5000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:21.739159 5003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:21.739040 5001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:21.739082 4990 server_base.cc:1034] running on GCE node
I20260810 01:37:21.739670 4990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:21.740383 4990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:21.741583 4990 hybrid_clock.cc:648] HybridClock initialized: now 1786325841741564 us; error 30 us; skew 500 ppm
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:21.744550 4990 init.cc:377] Logged in from keytab as oryx/127.24.205.130@KRBTEST.COM (short username oryx)
I20260810 01:37:21.745412 4990 webserver.cc:460] Webserver started at http://127.24.205.130:43423/ using document root <none> and password file <none>
I20260810 01:37:21.745996 4990 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:21.746060 4990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:21.746320 4990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:21.748458 4990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "a391f0be41d64e6fa51e4fbb63e18b10"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "626b843a134396187de49b3ab63baa8f"
server_key_iv: "dc07084893a2fb1747a4cccaf86ac819"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.749157 4990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "a391f0be41d64e6fa51e4fbb63e18b10"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "626b843a134396187de49b3ab63baa8f"
server_key_iv: "dc07084893a2fb1747a4cccaf86ac819"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.753114 4990 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:37:21.755545 5014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:21.756822 4990 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:21.756964 4990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "a391f0be41d64e6fa51e4fbb63e18b10"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "626b843a134396187de49b3ab63baa8f"
server_key_iv: "dc07084893a2fb1747a4cccaf86ac819"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.757078 4990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:21.767489 4990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:21.770298 4990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:21.770512 4990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:21.772053 4990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:21.772217 4990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:21.772285 4990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:21.772332 4990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:21.783463 4990 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:45843
I20260810 01:37:21.783495 5185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:45843 every 8 connection(s)
I20260810 01:37:21.784500 4990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:21.787766 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.773028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:40093 (local address 127.24.205.190:44699)
0810 01:37:21.773186 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:21.773191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:21.774143 (+ 952us) server_negotiation.cc:407] Connection header received
0810 01:37:21.775212 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:21.775216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:21.775278 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:21.775371 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:21.776985 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.777874 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.779898 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.780290 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.780394 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.783906 (+ 3512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:21.783910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:21.783913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:21.783950 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:21.785795 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.786369 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.786372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.786373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.786455 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.786775 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.786777 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.786778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.786966 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:21.787044 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:21.787517 (+ 473us) server_negotiation.cc:299] Negotiation successful
0810 01:37:21.787629 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 01:37:21.788667 5028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.773491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44699 (local address 127.24.205.130:40093)
0810 01:37:21.773965 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:21.774018 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:21.774983 (+ 965us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:21.775554 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:21.775565 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:21.776152 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:21.776804 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.776848 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.778080 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.778085 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.779736 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.779751 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.780472 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.780479 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.780729 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.781473 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:21.781500 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:21.783698 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:21.785888 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.785892 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.785903 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.786265 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.786540 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.786542 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.786543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.786681 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.787054 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:21.787059 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:21.787305 (+ 246us) client_negotiation.cc:769] Sending connection context
0810 01:37:21.787467 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 01:37:21.787748 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":154,"threads_started":1}
I20260810 01:37:21.790197 5186 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44699
I20260810 01:37:21.790369 5186 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:21.791226 5186 heartbeater.cc:511] Master 127.24.205.190:44699 requested a full tablet report, sending...
I20260810 01:37:21.792430 4683 ts_manager.cc:194] Registered new tserver with Master: a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843)
I20260810 01:37:21.792953 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 4990
I20260810 01:37:21.793138 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:21.793303 4683 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:40093
I20260810 01:37:21.793503 25398 external_mini_cluster.cc:1428] Setting key 4841ae103969bc3257ceb1109c1180a5
I20260810 01:37:21.802060 5198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.792753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44699 (local address 127.24.205.130:58201)
0810 01:37:21.793073 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:21.793089 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:21.793177 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:21.794252 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:21.794256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:21.794486 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:21.794640 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.794649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.795662 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.795668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.796699 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:21.796724 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.797267 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.797270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:21.797341 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.797895 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:21.797917 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:21.798245 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:21.800276 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.800278 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.800279 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.800564 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.800924 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:21.800927 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:21.800929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:21.801029 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:21.801625 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:21.801627 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:21.801708 (+ 81us) client_negotiation.cc:769] Sending connection context
0810 01:37:21.801794 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 01:37:21.801918 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":109,"threads_started":1}
I20260810 01:37:21.802287 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:21.793895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:58201 (local address 127.24.205.190:44699)
0810 01:37:21.794024 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:21.794028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:21.794041 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:21.794083 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:21.794086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:21.794130 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:21.794215 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:21.794777 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.795508 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.796836 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:21.797115 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:21.797256 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:21.798391 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:21.798398 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:21.798404 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:21.798439 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:21.800148 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.800676 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.800681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.800685 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.800792 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:21.801167 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:21.801173 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:21.801178 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:21.801515 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:21.801640 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:21.801898 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 01:37:21.802047 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
WARNING: no policy specified for oryx/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab.
Entry for principal oryx/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab.
I20260810 01:37:21.827948 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44699
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab
--principal=oryx/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:21.944240 5204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:21.944515 5204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:21.944602 5204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:21.948521 5204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:21.948622 5204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:21.948679 5204 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:37:21.948719 5204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:21.953763 5204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab
--principal=oryx/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.205.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:21.954779 5204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:21.955719 5204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:21.965045 5216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:21.965155 5213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:21.965210 5204 server_base.cc:1034] running on GCE node
W20260810 01:37:21.965047 5220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:21.965808 5204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:21.966343 5204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:21.967507 5204 hybrid_clock.cc:648] HybridClock initialized: now 1786325841967473 us; error 45 us; skew 500 ppm
Aug 10 01:37:21 dist-test-slave-t3q3 krb5kdc[4618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:21.970345 5204 init.cc:377] Logged in from keytab as oryx/127.24.205.131@KRBTEST.COM (short username oryx)
I20260810 01:37:21.971169 5204 webserver.cc:460] Webserver started at http://127.24.205.131:44933/ using document root <none> and password file <none>
I20260810 01:37:21.971721 5204 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:21.971784 5204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:21.972100 5204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:21.974141 5204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "ead4583a06b14ac29b54fb7f095fa2d0"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "ebaa4c6b817aab8b45e74c76b84f4aa8"
server_key_iv: "c64224bb0210e3375a5b3cc1decdf596"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.974726 5204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "ead4583a06b14ac29b54fb7f095fa2d0"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "ebaa4c6b817aab8b45e74c76b84f4aa8"
server_key_iv: "c64224bb0210e3375a5b3cc1decdf596"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.978441 5204 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260810 01:37:21.980854 5233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:21.982052 5204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:21.982193 5204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "ead4583a06b14ac29b54fb7f095fa2d0"
format_stamp: "Formatted at 2026-08-10 01:37:21 on dist-test-slave-t3q3"
server_key: "ebaa4c6b817aab8b45e74c76b84f4aa8"
server_key_iv: "c64224bb0210e3375a5b3cc1decdf596"
server_key_version: "encryptionkey@0"
I20260810 01:37:21.982306 5204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:22.002492 5204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:22.005571 5204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:22.005792 5204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:22.007292 5204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:22.007367 5204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:22.007442 5204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:22.007486 5204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:22.018738 5204 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:33063
I20260810 01:37:22.018833 5405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:33063 every 8 connection(s)
I20260810 01:37:22.019912 5204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:22.021967 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.008145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:36839 (local address 127.24.205.190:44699)
0810 01:37:22.008282 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.008286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.009315 (+ 1029us) server_negotiation.cc:407] Connection header received
0810 01:37:22.010411 (+ 1096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.010415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.010482 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.010548 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:22.012370 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.013227 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.014627 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.015056 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.015187 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.017944 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:22.017948 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:22.017952 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:22.017990 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:22.019806 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.020451 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.020454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.020456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.020546 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.020961 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.020964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.020965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.021207 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:22.021320 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.021752 (+ 432us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.021851 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:37:22.022791 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.008681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44699 (local address 127.24.205.131:36839)
0810 01:37:22.009154 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.009197 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.010140 (+ 943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.011020 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.011032 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.011482 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:22.012208 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.012231 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.013360 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.013363 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.014468 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.014486 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.015315 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.015320 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.015527 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.016121 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:22.016146 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:22.017768 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:22.019940 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:22.019944 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:22.019955 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:22.020288 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:22.020654 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:22.020657 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:22.020659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:22.020847 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:22.021321 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:22.021325 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:22.021532 (+ 207us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.021679 (+ 147us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.021907 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":131,"threads_started":1}
I20260810 01:37:22.023949 5406 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44699
I20260810 01:37:22.024111 5406 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:22.024673 5406 heartbeater.cc:511] Master 127.24.205.190:44699 requested a full tablet report, sending...
I20260810 01:37:22.025365 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 5204
I20260810 01:37:22.025511 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:22.025779 4682 ts_manager.cc:194] Registered new tserver with Master: ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063)
I20260810 01:37:22.025890 25398 external_mini_cluster.cc:1428] Setting key c1806641ab5081a16fcd665c92656082
I20260810 01:37:22.026528 4682 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:36839
I20260810 01:37:22.028012 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:37:22.033897 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.026389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:49887 (local address 127.24.205.190:44699)
0810 01:37:22.026824 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.026828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.026841 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:22.026883 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.026885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.026918 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.027013 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:22.027420 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.028052 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.029044 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.029436 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.029562 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.030724 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:22.030727 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:22.030729 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:22.030749 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:22.032242 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.032666 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.032673 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.032676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.032760 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.033056 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.033060 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.033062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.033239 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:22.033365 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.033702 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.033791 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358}
I20260810 01:37:22.034026 5414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.026347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44699 (local address 127.24.205.131:49887)
0810 01:37:22.026610 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.026625 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.026713 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.027034 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.027037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.027208 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:22.027301 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.027306 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.028201 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.028205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.028919 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.028928 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.029554 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.029557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.029633 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.030120 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:22.030132 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:22.030580 (+ 448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:22.032357 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:22.032362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:22.032364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:22.032564 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:22.032858 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:22.032861 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:22.032863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:22.032951 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:22.033386 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:22.033389 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:22.033515 (+ 126us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.033651 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.033801 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":113,"threads_started":1}
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325842, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:37:22.053845 4754 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:22.047738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46310 (local address 127.24.205.190:44699)
0810 01:37:22.047852 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.047856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.047868 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:37:22.047905 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.047907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.047943 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.048015 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:22.048764 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.049339 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.050295 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.050506 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.050586 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.053703 (+ 3117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46310: BlockingRecv error: recv got EOF from 127.0.0.1:46310 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325842, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:22.063584 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.055557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46324 (local address 127.24.205.190:44699)
0810 01:37:22.055696 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.055700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.055837 (+ 137us) server_negotiation.cc:407] Connection header received
0810 01:37:22.055979 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.055984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.056026 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.056171 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:22.056763 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.057245 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.058046 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.058264 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.058373 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.060667 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:22.060671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:22.060674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:22.060705 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:22.061963 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.062382 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.062386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.062387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.062469 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.062757 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.062761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.062763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.062936 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:22.063078 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.063311 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.063424 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:37:22.066397 4682 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:37:22.070032 4682 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:22.085476 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.078879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48256 (local address 127.24.205.130:45843)
0810 01:37:22.079244 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.079258 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.079618 (+ 360us) server_negotiation.cc:407] Connection header received
0810 01:37:22.079839 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.079844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.080055 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.080874 (+ 819us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:22.081004 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.082104 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.083780 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.084571 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.085010 (+ 439us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.085135 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.085188 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.085285 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":125,"threads_started":1}
I20260810 01:37:22.085512 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.079273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:33063 (local address 127.0.0.1:33336)
0810 01:37:22.080240 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.080253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.080342 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.080977 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.080980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.080998 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:22.081117 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.081126 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.082225 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.082228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.083551 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.083562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.084719 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.084723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.084974 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.085040 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.085153 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.085351 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"mutex_wait_us":114,"thread_start_us":91,"threads_started":1}
I20260810 01:37:22.085809 5440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.078685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:45843 (local address 127.0.0.1:48256)
0810 01:37:22.079515 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.079530 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.079697 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.080290 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.080296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.080324 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:22.080495 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.080502 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.082226 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.082228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.083659 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.083670 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.084722 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.084727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.084936 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.085040 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.085159 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.085664 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"mutex_wait_us":649,"thread_start_us":91,"threads_started":1}
I20260810 01:37:22.085822 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.079701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33336 (local address 127.24.205.131:33063)
0810 01:37:22.080613 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.080623 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.080642 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:37:22.080702 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.080705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.080841 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.080999 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:22.081258 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.082059 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.083688 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.084550 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.084743 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.084895 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.085590 (+ 695us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.085693 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":120,"threads_started":1}
I20260810 01:37:22.086040 5437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.078575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:35151 (local address 127.0.0.1:42036)
0810 01:37:22.079388 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.079439 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.079569 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.080409 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.080412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.080425 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:22.080678 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.080690 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.082204 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.082207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.083857 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.083864 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.084863 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.084867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.085320 (+ 453us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.085342 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.085412 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.085470 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":574,"thread_start_us":107,"threads_started":1}
I20260810 01:37:22.086429 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.079348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42036 (local address 127.24.205.129:35151)
0810 01:37:22.079948 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.079954 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.079973 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:37:22.080044 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.080048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.080274 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.080511 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:22.080798 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.081994 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.083977 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.084705 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.085016 (+ 311us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.085152 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.086204 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.086308 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":95,"threads_started":1}
I20260810 01:37:22.088783 5304 tablet_service.cc:1467] Processing CreateTablet for tablet c10ca6c29f7346269bf46de975526c8d (DEFAULT_TABLE table=test-table [id=6a217b3e3a8247aa91a7d6b5681ba4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.089856 5304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c10ca6c29f7346269bf46de975526c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.089461 4892 tablet_service.cc:1467] Processing CreateTablet for tablet c10ca6c29f7346269bf46de975526c8d (DEFAULT_TABLE table=test-table [id=6a217b3e3a8247aa91a7d6b5681ba4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.089988 5093 tablet_service.cc:1467] Processing CreateTablet for tablet c10ca6c29f7346269bf46de975526c8d (DEFAULT_TABLE table=test-table [id=6a217b3e3a8247aa91a7d6b5681ba4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.090610 4892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c10ca6c29f7346269bf46de975526c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.090958 5093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c10ca6c29f7346269bf46de975526c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.097712 5446 tablet_bootstrap.cc:492] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Bootstrap starting.
I20260810 01:37:22.099911 5446 tablet_bootstrap.cc:654] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.100384 5449 tablet_bootstrap.cc:492] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Bootstrap starting.
I20260810 01:37:22.100775 5446 log.cc:824] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:22.102085 5449 tablet_bootstrap.cc:654] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.102597 5446 tablet_bootstrap.cc:492] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: No bootstrap required, opened a new log
I20260810 01:37:22.102804 5446 ts_tablet_manager.cc:1397] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:37:22.103111 5451 tablet_bootstrap.cc:492] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Bootstrap starting.
I20260810 01:37:22.104843 5451 tablet_bootstrap.cc:654] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.105511 5451 log.cc:824] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:22.106043 5449 log.cc:824] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:22.106227 5446 raft_consensus.cc:348] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.106511 5446 raft_consensus.cc:374] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.106578 5446 raft_consensus.cc:729] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.107044 5446 consensus_queue.cc:260] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.107599 5451 tablet_bootstrap.cc:492] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: No bootstrap required, opened a new log
I20260810 01:37:22.107715 5406 heartbeater.cc:503] Master 127.24.205.190:44699 was elected leader, sending a full tablet report...
I20260810 01:37:22.107811 5451 ts_tablet_manager.cc:1397] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:37:22.108120 5446 ts_tablet_manager.cc:1428] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Time spent starting tablet: real 0.005s user 0.002s sys 0.005s
I20260810 01:37:22.108660 5449 tablet_bootstrap.cc:492] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: No bootstrap required, opened a new log
I20260810 01:37:22.108868 5449 ts_tablet_manager.cc:1397] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260810 01:37:22.111397 5451 raft_consensus.cc:348] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.111663 5451 raft_consensus.cc:374] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.111739 5451 raft_consensus.cc:729] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a391f0be41d64e6fa51e4fbb63e18b10, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.112293 5451 consensus_queue.cc:260] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.113306 5186 heartbeater.cc:503] Master 127.24.205.190:44699 was elected leader, sending a full tablet report...
I20260810 01:37:22.113127 5449 raft_consensus.cc:348] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.113348 5451 ts_tablet_manager.cc:1428] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:37:22.113408 5449 raft_consensus.cc:374] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.113468 5449 raft_consensus.cc:729] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce8e2b76c3e498bad71d2b4df045c71, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.113890 5449 consensus_queue.cc:260] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.114506 4978 heartbeater.cc:503] Master 127.24.205.190:44699 was elected leader, sending a full tablet report...
I20260810 01:37:22.114805 5449 ts_tablet_manager.cc:1428] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:37:22.148332 5456 raft_consensus.cc:482] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:22.148576 5456 raft_consensus.cc:504] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.149874 5456 leader_election.cc:288] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843)
I20260810 01:37:22.154772 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.150128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:35151 (local address 127.24.205.131:41289)
0810 01:37:22.150390 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.150407 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.150507 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.150815 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.150817 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.150831 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:22.151004 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.151012 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.152099 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.152103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.153504 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.153516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.154355 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.154358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.154441 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.154462 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.154525 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.154622 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":24}
I20260810 01:37:22.154781 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.150357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:41289 (local address 127.24.205.129:35151)
0810 01:37:22.150480 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.150484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.150498 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:37:22.150632 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.150635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.150691 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.150782 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:22.151146 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.151957 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.153635 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.154245 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.154365 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.154422 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.154575 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.154653 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:37:22.155057 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.150231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:40723 (local address 127.24.205.130:45843)
0810 01:37:22.150372 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.150376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.150663 (+ 287us) server_negotiation.cc:407] Connection header received
0810 01:37:22.150760 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.150766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.150815 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.150887 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:22.151187 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.151957 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.153869 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.154468 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.154616 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.154661 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.154868 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.154952 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:37:22.155072 5462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.150158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:45843 (local address 127.24.205.131:40723)
0810 01:37:22.150567 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.150579 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.150680 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.150907 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.150909 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.150921 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:22.151075 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.151083 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.152099 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.152103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.153754 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.153762 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.154617 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.154621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.154734 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.154755 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.154834 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.154904 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":86,"thread_start_us":147,"threads_started":1}
I20260810 01:37:22.155719 4917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10ca6c29f7346269bf46de975526c8d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" is_pre_election: true
I20260810 01:37:22.155851 5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10ca6c29f7346269bf46de975526c8d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" is_pre_election: true
I20260810 01:37:22.156101 4917 raft_consensus.cc:2454] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 0.
I20260810 01:37:22.156219 5121 raft_consensus.cc:2454] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 0.
I20260810 01:37:22.156620 5234 leader_election.cc:302] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce8e2b76c3e498bad71d2b4df045c71, ead4583a06b14ac29b54fb7f095fa2d0; no voters:
I20260810 01:37:22.156944 5456 raft_consensus.cc:2781] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:22.157035 5456 raft_consensus.cc:482] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:22.157079 5456 raft_consensus.cc:3037] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.158365 5456 raft_consensus.cc:504] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.158717 5456 leader_election.cc:288] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843)
I20260810 01:37:22.159083 4917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10ca6c29f7346269bf46de975526c8d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
I20260810 01:37:22.159109 5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10ca6c29f7346269bf46de975526c8d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a391f0be41d64e6fa51e4fbb63e18b10"
I20260810 01:37:22.159197 4917 raft_consensus.cc:3037] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.159240 5121 raft_consensus.cc:3037] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.160352 4917 raft_consensus.cc:2454] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 1.
I20260810 01:37:22.160549 5121 raft_consensus.cc:2454] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 1.
I20260810 01:37:22.160724 5234 leader_election.cc:302] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce8e2b76c3e498bad71d2b4df045c71, ead4583a06b14ac29b54fb7f095fa2d0; no voters:
I20260810 01:37:22.160897 5456 raft_consensus.cc:2781] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:22.161146 5456 raft_consensus.cc:686] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 LEADER]: Becoming Leader. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Running, Role: LEADER
I20260810 01:37:22.161517 5456 consensus_queue.cc:237] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.164318 4683 catalog_manager.cc:5495] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } health_report { overall_health: HEALTHY } } }
I20260810 01:37:22.184510 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.181227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.24.205.131:33063)
0810 01:37:22.181349 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.181353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.181365 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:37:22.181459 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.181462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.181514 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.181603 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:22.181832 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.182342 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.183146 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.183367 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.183444 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.183678 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:22.184176 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:22.184276 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.184337 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.184387 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:37:22.190430 5121 raft_consensus.cc:1261] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Refusing update from remote peer ead4583a06b14ac29b54fb7f095fa2d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.190656 4917 raft_consensus.cc:1261] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Refusing update from remote peer ead4583a06b14ac29b54fb7f095fa2d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.191275 5456 consensus_queue.cc:1035] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.191469 5465 consensus_queue.cc:1035] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.197989 5470 mvcc.cc:205] Tried to move back new op lower bound from 7316790649604263936 to 7316790649496100864. Current Snapshot: MvccSnapshot[applied={T|T < 7316790649604263936}]
I20260810 01:37:22.207136 4683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:22.207314 4683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:22.209760 4683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Sending DeleteTablet for 3 replicas of tablet c10ca6c29f7346269bf46de975526c8d
I20260810 01:37:22.210656 4892 tablet_service.cc:1514] Processing DeleteTablet for tablet c10ca6c29f7346269bf46de975526c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:42036
I20260810 01:37:22.210741 5304 tablet_service.cc:1514] Processing DeleteTablet for tablet c10ca6c29f7346269bf46de975526c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:33336
I20260810 01:37:22.211236 5487 tablet_replica.cc:330] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: stopping tablet replica
I20260810 01:37:22.211191 5093 tablet_service.cc:1514] Processing DeleteTablet for tablet c10ca6c29f7346269bf46de975526c8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:48256
I20260810 01:37:22.211436 4683 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:37:22.211561 5487 raft_consensus.cc:2229] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:22.211665 5486 tablet_replica.cc:330] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: stopping tablet replica
I20260810 01:37:22.211937 5487 raft_consensus.cc:2258] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.211978 5486 raft_consensus.cc:2229] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 01:37:22.212175 4683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:22.212478 5486 raft_consensus.cc:2258] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.213748 5487 ts_tablet_manager.cc:1905] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.213869 5486 ts_tablet_manager.cc:1905] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.216800 5486 ts_tablet_manager.cc:1918] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:22.216902 5486 log.cc:1196] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/c10ca6c29f7346269bf46de975526c8d
I20260810 01:37:22.217244 5486 ts_tablet_manager.cc:1939] T c10ca6c29f7346269bf46de975526c8d P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting consensus metadata
I20260810 01:37:22.217344 5487 ts_tablet_manager.cc:1918] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:22.217427 5487 log.cc:1196] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/c10ca6c29f7346269bf46de975526c8d
I20260810 01:37:22.217747 5487 ts_tablet_manager.cc:1939] T c10ca6c29f7346269bf46de975526c8d P ead4583a06b14ac29b54fb7f095fa2d0: Deleting consensus metadata
I20260810 01:37:22.218155 4892 tablet_service.cc:1467] Processing CreateTablet for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 (DEFAULT_TABLE table=test-table [id=4a3844a0d92f4c51a833a8f0161c0861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.218417 4892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.218514 4659 catalog_manager.cc:4841] TS 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151): tablet c10ca6c29f7346269bf46de975526c8d (table test-table [id=6a217b3e3a8247aa91a7d6b5681ba4ac]) successfully deleted
I20260810 01:37:22.218771 4659 catalog_manager.cc:4841] TS ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063): tablet c10ca6c29f7346269bf46de975526c8d (table test-table [id=6a217b3e3a8247aa91a7d6b5681ba4ac]) successfully deleted
I20260810 01:37:22.218786 5488 tablet_replica.cc:330] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: stopping tablet replica
I20260810 01:37:22.219148 5488 raft_consensus.cc:2229] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:22.219483 5488 raft_consensus.cc:2258] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.219966 5304 tablet_service.cc:1467] Processing CreateTablet for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 (DEFAULT_TABLE table=test-table [id=4a3844a0d92f4c51a833a8f0161c0861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.220257 5304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.220777 5449 tablet_bootstrap.cc:492] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Bootstrap starting.
I20260810 01:37:22.221716 5449 tablet_bootstrap.cc:654] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.222011 5488 ts_tablet_manager.cc:1905] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.222453 5446 tablet_bootstrap.cc:492] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Bootstrap starting.
I20260810 01:37:22.223068 5093 tablet_service.cc:1467] Processing CreateTablet for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 (DEFAULT_TABLE table=test-table [id=4a3844a0d92f4c51a833a8f0161c0861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.223325 5093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.223546 5446 tablet_bootstrap.cc:654] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.224565 5488 ts_tablet_manager.cc:1918] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:22.224648 5488 log.cc:1196] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/c10ca6c29f7346269bf46de975526c8d
I20260810 01:37:22.224963 5488 ts_tablet_manager.cc:1939] T c10ca6c29f7346269bf46de975526c8d P a391f0be41d64e6fa51e4fbb63e18b10: Deleting consensus metadata
I20260810 01:37:22.225670 5451 tablet_bootstrap.cc:492] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Bootstrap starting.
I20260810 01:37:22.226310 4663 catalog_manager.cc:4841] TS a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843): tablet c10ca6c29f7346269bf46de975526c8d (table test-table [id=6a217b3e3a8247aa91a7d6b5681ba4ac]) successfully deleted
I20260810 01:37:22.226557 5451 tablet_bootstrap.cc:654] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.227622 5451 tablet_bootstrap.cc:492] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: No bootstrap required, opened a new log
I20260810 01:37:22.227710 5451 ts_tablet_manager.cc:1397] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:22.227751 5446 tablet_bootstrap.cc:492] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: No bootstrap required, opened a new log
I20260810 01:37:22.227839 5446 ts_tablet_manager.cc:1397] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 01:37:22.228219 5451 raft_consensus.cc:348] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.228336 5451 raft_consensus.cc:374] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.228367 5451 raft_consensus.cc:729] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a391f0be41d64e6fa51e4fbb63e18b10, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.228289 5446 raft_consensus.cc:348] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.228411 5446 raft_consensus.cc:374] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.228444 5446 raft_consensus.cc:729] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.228482 5451 consensus_queue.cc:260] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.228561 5446 consensus_queue.cc:260] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.228725 5451 ts_tablet_manager.cc:1428] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:22.228844 5446 ts_tablet_manager.cc:1428] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260810 01:37:22.229761 5449 tablet_bootstrap.cc:492] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: No bootstrap required, opened a new log
I20260810 01:37:22.229844 5449 ts_tablet_manager.cc:1397] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260810 01:37:22.230317 5449 raft_consensus.cc:348] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.230422 5449 raft_consensus.cc:374] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.230455 5449 raft_consensus.cc:729] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce8e2b76c3e498bad71d2b4df045c71, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.230592 5449 consensus_queue.cc:260] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.230868 5449 ts_tablet_manager.cc:1428] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260810 01:37:22.270885 5407 tablet.cc:2369] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:22.285847 5187 tablet.cc:2369] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:22.320195 4979 tablet.cc:2369] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:37:22.416668 5460 raft_consensus.cc:482] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:22.416868 5460 raft_consensus.cc:504] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.418068 5460 leader_election.cc:288] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063)
I20260810 01:37:22.422565 5443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.418942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:42505 (local address 127.24.205.131:33063)
0810 01:37:22.419073 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.419077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.419204 (+ 127us) server_negotiation.cc:407] Connection header received
0810 01:37:22.419416 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.419420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.419476 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.419561 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:22.419858 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.420393 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.421543 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.421957 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.422076 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.422144 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.422351 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.422432 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:37:22.422595 5494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.418392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:35151 (local address 127.24.205.130:58807)
0810 01:37:22.418660 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.418677 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.418902 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.419339 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.419342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.419364 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:22.419494 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.419503 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.420427 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.420430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.421425 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.421436 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.422133 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.422136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.422246 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.422264 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.422364 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.422431 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":62,"thread_start_us":84,"threads_started":1}
I20260810 01:37:22.422590 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.418484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:58807 (local address 127.24.205.129:35151)
0810 01:37:22.418646 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.418651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.418803 (+ 152us) server_negotiation.cc:407] Connection header received
0810 01:37:22.419047 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.419050 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.419112 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.419170 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:22.419628 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.420300 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.421592 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.421979 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.422119 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.422178 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.422401 (+ 223us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.422486 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 01:37:22.422603 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.418798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:33063 (local address 127.24.205.130:42505)
0810 01:37:22.419116 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.419133 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.419286 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.419604 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.419608 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.419626 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:22.419745 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.419751 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.420534 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.420538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.421410 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.421420 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.422090 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.422093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.422209 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.422242 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.422305 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.422396 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":26,"thread_start_us":56,"threads_started":1}
I20260810 01:37:22.423256 4917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de1e1dacc48d4c0d9360f2d8e40d5fd9" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" is_pre_election: true
I20260810 01:37:22.423430 4917 raft_consensus.cc:2454] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 0.
I20260810 01:37:22.423623 5326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de1e1dacc48d4c0d9360f2d8e40d5fd9" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" is_pre_election: true
I20260810 01:37:22.423831 5015 leader_election.cc:302] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce8e2b76c3e498bad71d2b4df045c71, a391f0be41d64e6fa51e4fbb63e18b10; no voters:
I20260810 01:37:22.423902 5326 raft_consensus.cc:2454] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 0.
I20260810 01:37:22.424098 5460 raft_consensus.cc:2781] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:22.424165 5460 raft_consensus.cc:482] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:22.424216 5460 raft_consensus.cc:3037] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.425459 5460 raft_consensus.cc:504] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.425757 5460 leader_election.cc:288] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063)
I20260810 01:37:22.426111 4917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de1e1dacc48d4c0d9360f2d8e40d5fd9" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
I20260810 01:37:22.426191 5326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de1e1dacc48d4c0d9360f2d8e40d5fd9" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead4583a06b14ac29b54fb7f095fa2d0"
I20260810 01:37:22.426254 4917 raft_consensus.cc:3037] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.426335 5326 raft_consensus.cc:3037] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.427204 4917 raft_consensus.cc:2454] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 1.
I20260810 01:37:22.427374 5326 raft_consensus.cc:2454] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 1.
I20260810 01:37:22.427524 5015 leader_election.cc:302] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce8e2b76c3e498bad71d2b4df045c71, a391f0be41d64e6fa51e4fbb63e18b10; no voters:
I20260810 01:37:22.427722 5460 raft_consensus.cc:2781] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:22.427904 5460 raft_consensus.cc:686] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 LEADER]: Becoming Leader. State: Replica: a391f0be41d64e6fa51e4fbb63e18b10, State: Running, Role: LEADER
I20260810 01:37:22.428192 5460 consensus_queue.cc:237] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.430527 4679 catalog_manager.cc:5495] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 reported cstate change: term changed from 0 to 1, leader changed from <none> to a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } health_report { overall_health: UNKNOWN } } }
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325841, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.190@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:22.504153 5510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.489827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44699 (local address 127.0.0.1:46334)
0810 01:37:22.490192 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.490208 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.490323 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.490606 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.490609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.491184 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:22.491344 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.491351 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.492194 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.492197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.492795 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.492803 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.493225 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.493227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.493308 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.499230 (+ 5922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:22.499244 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:22.500795 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:22.502614 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:22.502623 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:22.502629 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:22.502877 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:22.503131 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:22.503133 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:22.503135 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:22.503212 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:22.503562 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:22.503568 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:22.503688 (+ 120us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.503782 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.503913 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":136,"threads_started":1}
I20260810 01:37:22.504161 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.489912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46334 (local address 127.24.205.190:44699)
0810 01:37:22.490068 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.490073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.490287 (+ 214us) server_negotiation.cc:407] Connection header received
0810 01:37:22.490405 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.490407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.490449 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.490522 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:22.491439 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.492038 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.492897 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.493119 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.493196 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.500949 (+ 7753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:22.500952 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:22.500954 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:22.500977 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:22.502417 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.502970 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.502972 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.502974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.503048 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.503291 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.503293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.503294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.503469 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:22.503547 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.503845 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.503973 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":75}
I20260810 01:37:22.508268 4679 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:46334:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 01:37:22.508949 4679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:22.513865 4892 tablet_service.cc:1467] Processing CreateTablet for tablet 6690f27931ee47cb86f9fb0207d0d849 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=33bfeb6bd3e54dbd9e59d76b1a78fbda]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:37:22.514012 5093 tablet_service.cc:1467] Processing CreateTablet for tablet 6690f27931ee47cb86f9fb0207d0d849 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=33bfeb6bd3e54dbd9e59d76b1a78fbda]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:37:22.514312 4892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6690f27931ee47cb86f9fb0207d0d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.514361 5093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6690f27931ee47cb86f9fb0207d0d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.514308 5304 tablet_service.cc:1467] Processing CreateTablet for tablet 6690f27931ee47cb86f9fb0207d0d849 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=33bfeb6bd3e54dbd9e59d76b1a78fbda]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:37:22.514729 5304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6690f27931ee47cb86f9fb0207d0d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.517309 5446 tablet_bootstrap.cc:492] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: Bootstrap starting.
I20260810 01:37:22.517354 5451 tablet_bootstrap.cc:492] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: Bootstrap starting.
I20260810 01:37:22.517369 5449 tablet_bootstrap.cc:492] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: Bootstrap starting.
I20260810 01:37:22.518359 5449 tablet_bootstrap.cc:654] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.518368 5446 tablet_bootstrap.cc:654] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.518425 5451 tablet_bootstrap.cc:654] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.519644 5449 tablet_bootstrap.cc:492] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: No bootstrap required, opened a new log
I20260810 01:37:22.519667 5446 tablet_bootstrap.cc:492] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: No bootstrap required, opened a new log
I20260810 01:37:22.519740 5446 ts_tablet_manager.cc:1397] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:37:22.519759 5449 ts_tablet_manager.cc:1397] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:22.520234 5451 tablet_bootstrap.cc:492] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: No bootstrap required, opened a new log
I20260810 01:37:22.520226 5446 raft_consensus.cc:348] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.520318 5451 ts_tablet_manager.cc:1397] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:37:22.520282 5449 raft_consensus.cc:348] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.520351 5446 raft_consensus.cc:374] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.520386 5449 raft_consensus.cc:374] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.520392 5446 raft_consensus.cc:729] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.520427 5449 raft_consensus.cc:729] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce8e2b76c3e498bad71d2b4df045c71, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.520519 5446 consensus_queue.cc:260] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.520553 5449 consensus_queue.cc:260] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.520835 5449 ts_tablet_manager.cc:1428] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:22.520783 5451 raft_consensus.cc:348] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.520887 5451 raft_consensus.cc:374] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.520923 5451 raft_consensus.cc:729] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a391f0be41d64e6fa51e4fbb63e18b10, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.520918 5446 ts_tablet_manager.cc:1428] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:22.521049 5451 consensus_queue.cc:260] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.521103 5456 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.521097 5461 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.521235 5456 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:37:22.521270 5461 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:37:22.521576 5460 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.521701 5460 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:37:22.522364 5451 ts_tablet_manager.cc:1428] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:22.599249 5460 raft_consensus.cc:482] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:22.599390 5460 raft_consensus.cc:504] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.599858 5460 leader_election.cc:288] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063)
I20260810 01:37:22.600391 4917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6690f27931ee47cb86f9fb0207d0d849" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" is_pre_election: true
I20260810 01:37:22.600464 5326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6690f27931ee47cb86f9fb0207d0d849" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" is_pre_election: true
I20260810 01:37:22.600560 4917 raft_consensus.cc:2454] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 0.
I20260810 01:37:22.600696 5326 raft_consensus.cc:2454] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 0.
I20260810 01:37:22.601040 5015 leader_election.cc:302] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a391f0be41d64e6fa51e4fbb63e18b10, ead4583a06b14ac29b54fb7f095fa2d0; no voters:
I20260810 01:37:22.601214 5460 raft_consensus.cc:2781] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:22.601290 5460 raft_consensus.cc:482] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:22.601337 5460 raft_consensus.cc:3037] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.602324 5460 raft_consensus.cc:504] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.602644 5460 leader_election.cc:288] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063)
I20260810 01:37:22.603024 5326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6690f27931ee47cb86f9fb0207d0d849" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead4583a06b14ac29b54fb7f095fa2d0"
I20260810 01:37:22.603050 4917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6690f27931ee47cb86f9fb0207d0d849" candidate_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
I20260810 01:37:22.603163 5326 raft_consensus.cc:3037] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.603171 4917 raft_consensus.cc:3037] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.604393 4917 raft_consensus.cc:2454] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 1.
I20260810 01:37:22.604605 5326 raft_consensus.cc:2454] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a391f0be41d64e6fa51e4fbb63e18b10 in term 1.
I20260810 01:37:22.604698 5015 leader_election.cc:302] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce8e2b76c3e498bad71d2b4df045c71, a391f0be41d64e6fa51e4fbb63e18b10; no voters:
I20260810 01:37:22.604905 5460 raft_consensus.cc:2781] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:22.604990 5460 raft_consensus.cc:686] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 LEADER]: Becoming Leader. State: Replica: a391f0be41d64e6fa51e4fbb63e18b10, State: Running, Role: LEADER
I20260810 01:37:22.605139 5460 consensus_queue.cc:237] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.605898 5496 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: TxnStatusTablet state changed. Reason: New leader a391f0be41d64e6fa51e4fbb63e18b10. Latest consensus state: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.606025 5496 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:37:22.606305 5518 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 01:37:22.606494 5518 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 01:37:22.606968 4679 catalog_manager.cc:5495] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 reported cstate change: term changed from 0 to 1, leader changed from <none> to a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } health_report { overall_health: UNKNOWN } } }
I20260810 01:37:22.624498 5510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.620114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:45843 (local address 127.0.0.1:48266)
0810 01:37:22.620382 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.620396 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.620491 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.620890 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.620894 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.620908 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:37:22.621045 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.621050 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.622094 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.622096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.622699 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.622707 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.623294 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.623296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.623368 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.623413 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:37:22.624237 (+ 824us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:37:22.624252 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.624313 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.624387 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260810 01:37:22.624521 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.620226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48266 (local address 127.24.205.130:45843)
0810 01:37:22.620369 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.620374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.620439 (+ 65us) server_negotiation.cc:407] Connection header received
0810 01:37:22.620625 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.620628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.620701 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.620831 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:22.621159 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.621977 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.622814 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.623174 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.623281 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.623574 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:22.624125 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:22.624246 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.624326 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.624384 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:37:22.627328 4917 raft_consensus.cc:1261] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Refusing update from remote peer a391f0be41d64e6fa51e4fbb63e18b10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.627552 5326 raft_consensus.cc:1261] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Refusing update from remote peer a391f0be41d64e6fa51e4fbb63e18b10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.627840 5460 consensus_queue.cc:1035] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.628077 5496 consensus_queue.cc:1035] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.629500 5461 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: TxnStatusTablet state changed. Reason: New leader a391f0be41d64e6fa51e4fbb63e18b10. Latest consensus state: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.629613 5461 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:37:22.629762 5456 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: TxnStatusTablet state changed. Reason: New leader a391f0be41d64e6fa51e4fbb63e18b10. Latest consensus state: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.629868 5456 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:37:22.631369 5460 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.631477 5460 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:37:22.631944 5471 mvcc.cc:205] Tried to move back new op lower bound from 7316790651396644864 to 7316790651312201728. Current Snapshot: MvccSnapshot[applied={T|T < 7316790651396644864}]
I20260810 01:37:22.632145 5461 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.632254 5461 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P 9ce8e2b76c3e498bad71d2b4df045c71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:37:22.636205 5496 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.636319 5496 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P a391f0be41d64e6fa51e4fbb63e18b10: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:37:22.637348 5456 tablet_replica.cc:439] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } } }
I20260810 01:37:22.637455 5456 tablet_replica.cc:442] T 6690f27931ee47cb86f9fb0207d0d849 P ead4583a06b14ac29b54fb7f095fa2d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:37:22.639665 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.635586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48278 (local address 127.24.205.130:45843)
0810 01:37:22.635824 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.635828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.635843 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:22.635955 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.635958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.636008 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.636105 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:22.636449 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.637089 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.638424 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.638730 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.638828 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.639209 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:22.639296 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:22.639371 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.639519 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.639573 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260810 01:37:22.649856 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.646487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:38395 (local address 127.24.205.130:45843)
0810 01:37:22.646601 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.646606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.646776 (+ 170us) server_negotiation.cc:407] Connection header received
0810 01:37:22.646922 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.646927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.646970 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.647048 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:22.647292 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.647757 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.648691 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.648977 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.649082 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.649411 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:22.649470 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:22.649548 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.649665 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.649718 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:37:22.649860 5530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.646394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:45843 (local address 127.24.205.130:38395)
0810 01:37:22.646694 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:22.646706 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:22.646821 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:22.647055 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:22.647058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:22.647081 (+ 23us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:37:22.647185 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.647190 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.647865 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.647871 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.648573 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:22.648582 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.649095 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.649098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:22.649205 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.649248 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:37:22.649550 (+ 302us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:37:22.649557 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:37:22.649626 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:37:22.649699 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":90,"threads_started":1}
I20260810 01:37:22.656299 5326 raft_consensus.cc:1261] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Refusing update from remote peer a391f0be41d64e6fa51e4fbb63e18b10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.656299 4917 raft_consensus.cc:1261] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Refusing update from remote peer a391f0be41d64e6fa51e4fbb63e18b10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.656703 5534 consensus_queue.cc:1035] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.656854 5496 consensus_queue.cc:1035] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.660622 5474 mvcc.cc:205] Tried to move back new op lower bound from 7316790651516276736 to 7316790650588368896. Current Snapshot: MvccSnapshot[applied={T|T < 7316790651516276736}]
I20260810 01:37:22.697407 4683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:22.697557 4683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:22.699532 4683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Sending DeleteTablet for 3 replicas of tablet de1e1dacc48d4c0d9360f2d8e40d5fd9
I20260810 01:37:22.700089 4892 tablet_service.cc:1514] Processing DeleteTablet for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:42036
I20260810 01:37:22.700169 5093 tablet_service.cc:1514] Processing DeleteTablet for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:48256
I20260810 01:37:22.700273 5304 tablet_service.cc:1514] Processing DeleteTablet for tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:33336
I20260810 01:37:22.700377 5488 tablet_replica.cc:330] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: stopping tablet replica
I20260810 01:37:22.700377 5486 tablet_replica.cc:330] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: stopping tablet replica
I20260810 01:37:22.700457 5487 tablet_replica.cc:330] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: stopping tablet replica
I20260810 01:37:22.700495 5486 raft_consensus.cc:2229] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:22.700500 5488 raft_consensus.cc:2229] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:22.700557 5487 raft_consensus.cc:2229] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:22.700606 5486 raft_consensus.cc:2258] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.700657 5487 raft_consensus.cc:2258] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.700829 5488 raft_consensus.cc:2258] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.701633 5486 ts_tablet_manager.cc:1905] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.701640 5488 ts_tablet_manager.cc:1905] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.701743 5487 ts_tablet_manager.cc:1905] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.704442 5488 ts_tablet_manager.cc:1918] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:37:22.704512 5488 log.cc:1196] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/de1e1dacc48d4c0d9360f2d8e40d5fd9
I20260810 01:37:22.704492 5486 ts_tablet_manager.cc:1918] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:37:22.704492 5487 ts_tablet_manager.cc:1918] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:37:22.704567 5486 log.cc:1196] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/de1e1dacc48d4c0d9360f2d8e40d5fd9
I20260810 01:37:22.704582 5487 log.cc:1196] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/de1e1dacc48d4c0d9360f2d8e40d5fd9
I20260810 01:37:22.704789 5488 ts_tablet_manager.cc:1939] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P a391f0be41d64e6fa51e4fbb63e18b10: Deleting consensus metadata
I20260810 01:37:22.704865 5486 ts_tablet_manager.cc:1939] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting consensus metadata
I20260810 01:37:22.704865 5487 ts_tablet_manager.cc:1939] T de1e1dacc48d4c0d9360f2d8e40d5fd9 P ead4583a06b14ac29b54fb7f095fa2d0: Deleting consensus metadata
I20260810 01:37:22.705562 4659 catalog_manager.cc:4841] TS ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063): tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 (table test-table [id=4a3844a0d92f4c51a833a8f0161c0861]) successfully deleted
I20260810 01:37:22.705893 4663 catalog_manager.cc:4841] TS a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843): tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 (table test-table [id=4a3844a0d92f4c51a833a8f0161c0861]) successfully deleted
I20260810 01:37:22.709378 4659 catalog_manager.cc:4841] TS 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151): tablet de1e1dacc48d4c0d9360f2d8e40d5fd9 (table test-table [id=4a3844a0d92f4c51a833a8f0161c0861]) successfully deleted
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:37:22.743496 4754 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:22.735310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46350 (local address 127.24.205.190:44699)
0810 01:37:22.735452 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.735458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.735475 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:37:22.735533 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.735538 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.735592 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.735685 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:22.736769 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.737627 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.738905 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.739242 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.739311 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.743364 (+ 4053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46350: BlockingRecv error: recv got EOF from 127.0.0.1:46350 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 01:37:22 dist-test-slave-t3q3 krb5kdc[4618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM
I20260810 01:37:22.758661 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.747963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46360 (local address 127.24.205.190:44699)
0810 01:37:22.748134 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.748140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.748157 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:37:22.748204 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.748209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.748274 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.748360 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:22.749259 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.750136 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.751315 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.751677 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.751821 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.754860 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:22.754866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:22.754870 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:22.754905 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:22.756777 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.757269 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.757274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.757276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.757403 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:22.757679 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:22.757683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:22.757685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:22.757948 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:22.758091 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.758358 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.758482 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:37:22.761915 4683 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:37:22.762437 4683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:22.769142 4892 tablet_service.cc:1467] Processing CreateTablet for tablet 8f1ec8a7ff3640feaaf800e84aafa82d (DEFAULT_TABLE table=test-table [id=3f6a27921c3f4e968280745b427361b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.769197 5093 tablet_service.cc:1467] Processing CreateTablet for tablet 8f1ec8a7ff3640feaaf800e84aafa82d (DEFAULT_TABLE table=test-table [id=3f6a27921c3f4e968280745b427361b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.769459 5093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f1ec8a7ff3640feaaf800e84aafa82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.769497 4892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f1ec8a7ff3640feaaf800e84aafa82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.771739 5451 tablet_bootstrap.cc:492] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: Bootstrap starting.
I20260810 01:37:22.772166 5449 tablet_bootstrap.cc:492] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: Bootstrap starting.
I20260810 01:37:22.772692 5304 tablet_service.cc:1467] Processing CreateTablet for tablet 8f1ec8a7ff3640feaaf800e84aafa82d (DEFAULT_TABLE table=test-table [id=3f6a27921c3f4e968280745b427361b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.772842 5451 tablet_bootstrap.cc:654] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.773005 5304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f1ec8a7ff3640feaaf800e84aafa82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.773167 5449 tablet_bootstrap.cc:654] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.774461 5451 tablet_bootstrap.cc:492] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: No bootstrap required, opened a new log
I20260810 01:37:22.774562 5451 ts_tablet_manager.cc:1397] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:37:22.775156 5451 raft_consensus.cc:348] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.775328 5451 raft_consensus.cc:374] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.775359 5451 raft_consensus.cc:729] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a391f0be41d64e6fa51e4fbb63e18b10, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.775520 5446 tablet_bootstrap.cc:492] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: Bootstrap starting.
I20260810 01:37:22.775517 5451 consensus_queue.cc:260] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.775782 5451 ts_tablet_manager.cc:1428] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:22.776481 5446 tablet_bootstrap.cc:654] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.777822 5449 tablet_bootstrap.cc:492] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: No bootstrap required, opened a new log
I20260810 01:37:22.777918 5449 ts_tablet_manager.cc:1397] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:37:22.778035 5446 tablet_bootstrap.cc:492] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: No bootstrap required, opened a new log
I20260810 01:37:22.778120 5446 ts_tablet_manager.cc:1397] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 01:37:22.778394 5449 raft_consensus.cc:348] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.778504 5449 raft_consensus.cc:374] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.778538 5449 raft_consensus.cc:729] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce8e2b76c3e498bad71d2b4df045c71, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.778539 5446 raft_consensus.cc:348] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.778626 5446 raft_consensus.cc:374] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:22.778646 5446 raft_consensus.cc:729] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Initialized, Role: FOLLOWER
I20260810 01:37:22.778752 5446 consensus_queue.cc:260] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.778999 5446 ts_tablet_manager.cc:1428] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:22.778663 5449 consensus_queue.cc:260] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.780046 5449 ts_tablet_manager.cc:1428] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:22.920966 5456 raft_consensus.cc:482] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:22.921172 5456 raft_consensus.cc:504] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.921715 5456 leader_election.cc:288] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843)
I20260810 01:37:22.922231 5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f1ec8a7ff3640feaaf800e84aafa82d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" is_pre_election: true
I20260810 01:37:22.922398 5121 raft_consensus.cc:2454] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 0.
I20260810 01:37:22.922640 4916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f1ec8a7ff3640feaaf800e84aafa82d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" is_pre_election: true
I20260810 01:37:22.922773 5237 leader_election.cc:302] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a391f0be41d64e6fa51e4fbb63e18b10, ead4583a06b14ac29b54fb7f095fa2d0; no voters:
I20260810 01:37:22.922816 4916 raft_consensus.cc:2454] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 0.
I20260810 01:37:22.923058 5456 raft_consensus.cc:2781] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:22.923125 5456 raft_consensus.cc:482] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:22.923178 5456 raft_consensus.cc:3037] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.924620 5456 raft_consensus.cc:504] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.925009 5456 leader_election.cc:288] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843)
I20260810 01:37:22.925411 4916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f1ec8a7ff3640feaaf800e84aafa82d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
I20260810 01:37:22.925422 5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f1ec8a7ff3640feaaf800e84aafa82d" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a391f0be41d64e6fa51e4fbb63e18b10"
I20260810 01:37:22.925544 5121 raft_consensus.cc:3037] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.925550 4916 raft_consensus.cc:3037] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:22.926542 4916 raft_consensus.cc:2454] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 1.
I20260810 01:37:22.926764 5121 raft_consensus.cc:2454] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 1.
I20260810 01:37:22.926898 5234 leader_election.cc:302] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce8e2b76c3e498bad71d2b4df045c71, ead4583a06b14ac29b54fb7f095fa2d0; no voters:
I20260810 01:37:22.927124 5456 raft_consensus.cc:2781] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:22.927336 5456 raft_consensus.cc:686] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 LEADER]: Becoming Leader. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Running, Role: LEADER
I20260810 01:37:22.927495 5456 consensus_queue.cc:237] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:22.929399 4679 catalog_manager.cc:5495] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } health_report { overall_health: HEALTHY } } }
I20260810 01:37:22.973035 5567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:22.969934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33354 (local address 127.24.205.131:33063)
0810 01:37:22.970165 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:22.970169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:22.970182 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:22.970229 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:22.970231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:22.970274 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:22.970352 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:22.970582 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.971132 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.972001 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:22.972255 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:22.972335 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:22.972563 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:22.972633 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:22.972719 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:22.972785 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 01:37:22.972833 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":86,"threads_started":1}
I20260810 01:37:22.975011 5121 raft_consensus.cc:1261] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Refusing update from remote peer ead4583a06b14ac29b54fb7f095fa2d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.975044 4916 raft_consensus.cc:1261] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Refusing update from remote peer ead4583a06b14ac29b54fb7f095fa2d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:22.975553 5456 consensus_queue.cc:1035] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.975716 5561 consensus_queue.cc:1035] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:22.983554 4682 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:22.983675 4682 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:22.985611 4682 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Sending DeleteTablet for 3 replicas of tablet 8f1ec8a7ff3640feaaf800e84aafa82d
I20260810 01:37:22.986207 4892 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f1ec8a7ff3640feaaf800e84aafa82d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:42036
I20260810 01:37:22.986402 5486 tablet_replica.cc:330] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: stopping tablet replica
I20260810 01:37:22.986413 5304 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f1ec8a7ff3640feaaf800e84aafa82d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:33336
I20260810 01:37:22.986536 5486 raft_consensus.cc:2229] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:22.986562 5487 tablet_replica.cc:330] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: stopping tablet replica
I20260810 01:37:22.986580 5093 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f1ec8a7ff3640feaaf800e84aafa82d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:22 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:48256
I20260810 01:37:22.986658 5487 raft_consensus.cc:2229] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:22.986675 5486 raft_consensus.cc:2258] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.986828 5487 raft_consensus.cc:2258] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.987018 5488 tablet_replica.cc:330] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: stopping tablet replica
I20260810 01:37:22.987134 5488 raft_consensus.cc:2229] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:22.987241 5488 raft_consensus.cc:2258] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:22.987170 4682 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:37:22.987583 4682 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:22.987880 5488 ts_tablet_manager.cc:1905] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.987965 5486 ts_tablet_manager.cc:1905] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.988725 5487 ts_tablet_manager.cc:1905] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:22.990403 5488 ts_tablet_manager.cc:1918] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:22.990497 5488 log.cc:1196] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/8f1ec8a7ff3640feaaf800e84aafa82d
I20260810 01:37:22.990588 5486 ts_tablet_manager.cc:1918] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:22.990674 5486 log.cc:1196] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/8f1ec8a7ff3640feaaf800e84aafa82d
I20260810 01:37:22.990829 5488 ts_tablet_manager.cc:1939] T 8f1ec8a7ff3640feaaf800e84aafa82d P a391f0be41d64e6fa51e4fbb63e18b10: Deleting consensus metadata
I20260810 01:37:22.990950 5486 ts_tablet_manager.cc:1939] T 8f1ec8a7ff3640feaaf800e84aafa82d P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting consensus metadata
I20260810 01:37:22.991472 5487 ts_tablet_manager.cc:1918] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:22.991492 4663 catalog_manager.cc:4841] TS a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843): tablet 8f1ec8a7ff3640feaaf800e84aafa82d (table test-table [id=3f6a27921c3f4e968280745b427361b0]) successfully deleted
I20260810 01:37:22.991562 5487 log.cc:1196] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/8f1ec8a7ff3640feaaf800e84aafa82d
I20260810 01:37:22.991709 4659 catalog_manager.cc:4841] TS 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151): tablet 8f1ec8a7ff3640feaaf800e84aafa82d (table test-table [id=3f6a27921c3f4e968280745b427361b0]) successfully deleted
I20260810 01:37:22.991796 5487 ts_tablet_manager.cc:1939] T 8f1ec8a7ff3640feaaf800e84aafa82d P ead4583a06b14ac29b54fb7f095fa2d0: Deleting consensus metadata
I20260810 01:37:22.992367 4659 catalog_manager.cc:4841] TS ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063): tablet 8f1ec8a7ff3640feaaf800e84aafa82d (table test-table [id=3f6a27921c3f4e968280745b427361b0]) successfully deleted
I20260810 01:37:22.995908 4892 tablet_service.cc:1467] Processing CreateTablet for tablet 81db5200c6b64c61862bca53ef2af07c (DEFAULT_TABLE table=test-table [id=7a06e5e733ab40ada1be2fefc53d2bb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.995930 5093 tablet_service.cc:1467] Processing CreateTablet for tablet 81db5200c6b64c61862bca53ef2af07c (DEFAULT_TABLE table=test-table [id=7a06e5e733ab40ada1be2fefc53d2bb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.996204 5093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81db5200c6b64c61862bca53ef2af07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.996205 4892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81db5200c6b64c61862bca53ef2af07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.996188 5304 tablet_service.cc:1467] Processing CreateTablet for tablet 81db5200c6b64c61862bca53ef2af07c (DEFAULT_TABLE table=test-table [id=7a06e5e733ab40ada1be2fefc53d2bb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:22.996407 5304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81db5200c6b64c61862bca53ef2af07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:22.998481 5446 tablet_bootstrap.cc:492] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: Bootstrap starting.
I20260810 01:37:22.998783 5451 tablet_bootstrap.cc:492] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: Bootstrap starting.
I20260810 01:37:22.999275 5446 tablet_bootstrap.cc:654] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:22.999511 5451 tablet_bootstrap.cc:654] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:23.000475 5446 tablet_bootstrap.cc:492] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: No bootstrap required, opened a new log
I20260810 01:37:23.000581 5446 ts_tablet_manager.cc:1397] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:23.000690 5451 tablet_bootstrap.cc:492] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: No bootstrap required, opened a new log
I20260810 01:37:23.000795 5451 ts_tablet_manager.cc:1397] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:23.000989 5446 raft_consensus.cc:348] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.001104 5446 raft_consensus.cc:374] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:23.001156 5446 raft_consensus.cc:729] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Initialized, Role: FOLLOWER
I20260810 01:37:23.001197 5451 raft_consensus.cc:348] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.001283 5446 consensus_queue.cc:260] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.001317 5451 raft_consensus.cc:374] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:23.001374 5451 raft_consensus.cc:729] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a391f0be41d64e6fa51e4fbb63e18b10, State: Initialized, Role: FOLLOWER
I20260810 01:37:23.001499 5451 consensus_queue.cc:260] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.001550 5446 ts_tablet_manager.cc:1428] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:23.001782 5451 ts_tablet_manager.cc:1428] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:37:23.002089 5449 tablet_bootstrap.cc:492] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71: Bootstrap starting.
I20260810 01:37:23.003064 5449 tablet_bootstrap.cc:654] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:23.004184 5449 tablet_bootstrap.cc:492] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71: No bootstrap required, opened a new log
I20260810 01:37:23.004304 5449 ts_tablet_manager.cc:1397] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 01:37:23.004730 5449 raft_consensus.cc:348] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.004823 5449 raft_consensus.cc:374] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:23.004876 5449 raft_consensus.cc:729] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce8e2b76c3e498bad71d2b4df045c71, State: Initialized, Role: FOLLOWER
I20260810 01:37:23.005028 5449 consensus_queue.cc:260] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.005362 5449 ts_tablet_manager.cc:1428] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:37:23.009508 5456 raft_consensus.cc:482] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:23.009603 5456 raft_consensus.cc:504] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.009976 5456 leader_election.cc:288] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843)
I20260810 01:37:23.010316 5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81db5200c6b64c61862bca53ef2af07c" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" is_pre_election: true
I20260810 01:37:23.010447 5121 raft_consensus.cc:2454] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 0.
I20260810 01:37:23.010726 4916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81db5200c6b64c61862bca53ef2af07c" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" is_pre_election: true
I20260810 01:37:23.010758 5237 leader_election.cc:302] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a391f0be41d64e6fa51e4fbb63e18b10, ead4583a06b14ac29b54fb7f095fa2d0; no voters:
I20260810 01:37:23.010854 4916 raft_consensus.cc:2454] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 0.
I20260810 01:37:23.010926 5456 raft_consensus.cc:2781] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:23.010970 5456 raft_consensus.cc:482] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:23.011029 5456 raft_consensus.cc:3037] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:23.012001 5456 raft_consensus.cc:504] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.012406 5456 leader_election.cc:288] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151), a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843)
I20260810 01:37:23.012679 4916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81db5200c6b64c61862bca53ef2af07c" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce8e2b76c3e498bad71d2b4df045c71"
I20260810 01:37:23.012812 4916 raft_consensus.cc:3037] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:23.012774 5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81db5200c6b64c61862bca53ef2af07c" candidate_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a391f0be41d64e6fa51e4fbb63e18b10"
I20260810 01:37:23.012921 5121 raft_consensus.cc:3037] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:23.013674 4916 raft_consensus.cc:2454] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 1.
I20260810 01:37:23.013906 5121 raft_consensus.cc:2454] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead4583a06b14ac29b54fb7f095fa2d0 in term 1.
I20260810 01:37:23.013948 5234 leader_election.cc:302] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce8e2b76c3e498bad71d2b4df045c71, ead4583a06b14ac29b54fb7f095fa2d0; no voters:
I20260810 01:37:23.014122 5456 raft_consensus.cc:2781] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:23.014225 5456 raft_consensus.cc:686] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 LEADER]: Becoming Leader. State: Replica: ead4583a06b14ac29b54fb7f095fa2d0, State: Running, Role: LEADER
I20260810 01:37:23.014360 5456 consensus_queue.cc:237] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } }
I20260810 01:37:23.015730 4679 catalog_manager.cc:5495] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ead4583a06b14ac29b54fb7f095fa2d0" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33063 } health_report { overall_health: HEALTHY } } }
I20260810 01:37:23.041206 5585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:23.037535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:45843 (local address 127.24.205.131:59355)
0810 01:37:23.037947 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:23.037959 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:23.038048 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:23.038287 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:23.038289 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:23.038296 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:37:23.038382 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:23.038386 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.039371 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.039373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:23.039985 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:23.039993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.040571 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.040574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:23.040639 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:23.040689 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:37:23.040971 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:37:23.040975 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:37:23.041025 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 01:37:23.041092 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":122,"threads_started":1}
I20260810 01:37:23.041210 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:23.037646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:59355 (local address 127.24.205.130:45843)
0810 01:37:23.037771 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:23.037776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:23.038024 (+ 248us) server_negotiation.cc:407] Connection header received
0810 01:37:23.038136 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:23.038139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:23.038187 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:23.038271 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:23.038474 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.039264 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.040121 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.040464 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.040560 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:23.040812 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:23.040890 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:23.040959 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:23.041034 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 01:37:23.041081 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:37:23.047454 4916 raft_consensus.cc:1261] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Refusing update from remote peer ead4583a06b14ac29b54fb7f095fa2d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:23.047454 5121 raft_consensus.cc:1261] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Refusing update from remote peer ead4583a06b14ac29b54fb7f095fa2d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:23.047873 5456 consensus_queue.cc:1035] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce8e2b76c3e498bad71d2b4df045c71" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:23.048025 5561 consensus_queue.cc:1035] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a391f0be41d64e6fa51e4fbb63e18b10" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:23.064193 5530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:23.060887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:33063 (local address 127.24.205.130:47697)
0810 01:37:23.061010 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:23.061025 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:23.061104 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:23.061380 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:23.061383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:23.061393 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:37:23.061509 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:23.061516 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.062300 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.062302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:23.062883 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:23.062891 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.063422 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.063425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:23.063515 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:23.063551 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:37:23.063863 (+ 312us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:37:23.063869 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:37:23.063926 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 01:37:23.064000 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 01:37:23.064193 5567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:23.060938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:47697 (local address 127.24.205.131:33063)
0810 01:37:23.061051 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:23.061055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:23.061066 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:37:23.061210 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:23.061216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:23.061276 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:23.061348 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:23.061645 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.062198 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.062989 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:23.063298 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:23.063413 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:23.063675 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:23.063784 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:23.063859 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:23.063947 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 01:37:23.064006 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:37:23.083853 4679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:23.084003 4679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:23.085924 4679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8858576b51e42f9bb51150cc70ad966: Sending DeleteTablet for 3 replicas of tablet 81db5200c6b64c61862bca53ef2af07c
I20260810 01:37:23.086469 4892 tablet_service.cc:1514] Processing DeleteTablet for tablet 81db5200c6b64c61862bca53ef2af07c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:23 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:42036
I20260810 01:37:23.086555 5304 tablet_service.cc:1514] Processing DeleteTablet for tablet 81db5200c6b64c61862bca53ef2af07c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:23 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:33336
I20260810 01:37:23.086664 5486 tablet_replica.cc:330] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71: stopping tablet replica
I20260810 01:37:23.086725 5487 tablet_replica.cc:330] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: stopping tablet replica
I20260810 01:37:23.086738 5093 tablet_service.cc:1514] Processing DeleteTablet for tablet 81db5200c6b64c61862bca53ef2af07c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:23 UTC) from {username='oryx', principal='oryx/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:48256
I20260810 01:37:23.086802 5486 raft_consensus.cc:2229] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:23.086848 5487 raft_consensus.cc:2229] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:23.086928 5486 raft_consensus.cc:2258] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:23.087097 5487 raft_consensus.cc:2258] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:23.087296 5488 tablet_replica.cc:330] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: stopping tablet replica
I20260810 01:37:23.087435 5488 raft_consensus.cc:2229] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:23.087551 5488 raft_consensus.cc:2258] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:23.087540 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 4791
I20260810 01:37:23.087728 5486 ts_tablet_manager.cc:1905] T 81db5200c6b64c61862bca53ef2af07c P 9ce8e2b76c3e498bad71d2b4df045c71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:23.092499 5488 ts_tablet_manager.cc:1905] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:23.095465 5488 ts_tablet_manager.cc:1918] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:37:23.095546 5488 log.cc:1196] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/81db5200c6b64c61862bca53ef2af07c
I20260810 01:37:23.095803 5488 ts_tablet_manager.cc:1939] T 81db5200c6b64c61862bca53ef2af07c P a391f0be41d64e6fa51e4fbb63e18b10: Deleting consensus metadata
I20260810 01:37:23.097548 5487 ts_tablet_manager.cc:1905] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:23.100796 4663 catalog_manager.cc:4841] TS a391f0be41d64e6fa51e4fbb63e18b10 (127.24.205.130:45843): tablet 81db5200c6b64c61862bca53ef2af07c (table test-table [id=7a06e5e733ab40ada1be2fefc53d2bb6]) successfully deleted
I20260810 01:37:23.100863 5487 ts_tablet_manager.cc:1918] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:37:23.100962 5487 log.cc:1196] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/81db5200c6b64c61862bca53ef2af07c
I20260810 01:37:23.101353 5487 ts_tablet_manager.cc:1939] T 81db5200c6b64c61862bca53ef2af07c P ead4583a06b14ac29b54fb7f095fa2d0: Deleting consensus metadata
I20260810 01:37:23.102200 4659 catalog_manager.cc:4841] TS ead4583a06b14ac29b54fb7f095fa2d0 (127.24.205.131:33063): tablet 81db5200c6b64c61862bca53ef2af07c (table test-table [id=7a06e5e733ab40ada1be2fefc53d2bb6]) successfully deleted
W20260810 01:37:23.108112 4659 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:35151 (error 108)
I20260810 01:37:23.108251 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 4990
I20260810 01:37:23.114723 5592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:23.114113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:35151 (local address 127.0.0.1:42038)
0810 01:37:23.114439 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:23.114552 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:35151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":65,"threads_started":1}
W20260810 01:37:23.114877 4659 catalog_manager.cc:4584] TS 9ce8e2b76c3e498bad71d2b4df045c71 (127.24.205.129:35151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 81db5200c6b64c61862bca53ef2af07c: Network error: Client connection negotiation failed: client connection to 127.24.205.129:35151: connect: Connection refused (error 111)
I20260810 01:37:23.124871 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 5204
I20260810 01:37:23.144634 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 4639
2026-08-10T01:37:23Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3458 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:23 dist-test-slave-t3q3 krb5kdc[5597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:23 dist-test-slave-t3q3 krb5kdc[5597](info): set up 2 sockets
Aug 10 01:37:23 dist-test-slave-t3q3 krb5kdc[5597](info): commencing operation
krb5kdc: starting...
W20260810 01:37:24.429236 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:24 dist-test-slave-t3q3 krb5kdc[5597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:24.559134 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:36223
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:36223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:24.672886 5619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:24.673182 5619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:24.673223 5619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:24.677377 5619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:24.677443 5619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:24.677461 5619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:24.677479 5619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:24.677495 5619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:24.682891 5619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:36223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:36223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:24.684054 5619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:24.685170 5619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:24.694152 5627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:24.694267 5619 server_base.cc:1034] running on GCE node
W20260810 01:37:24.694141 5630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:24.694141 5624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:24.695048 5619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:24.696337 5619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:24.697548 5619 hybrid_clock.cc:648] HybridClock initialized: now 1786325844697530 us; error 29 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T01:37:24Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1554 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:24 dist-test-slave-t3q3 krb5kdc[5638](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:24 dist-test-slave-t3q3 krb5kdc[5638](info): set up 2 sockets
Aug 10 01:37:24 dist-test-slave-t3q3 krb5kdc[5638](info): commencing operation
krb5kdc: starting...
W20260810 01:37:25.963181 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:26.095121 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44541
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:44541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:26.206137 5656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:26.206447 5656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:26.206527 5656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:26.210433 5656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:26.210534 5656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:26.210577 5656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:26.210613 5656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:26.210646 5656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:26.215896 5656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:44541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:26.217002 5656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:26.218039 5656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:26.226668 5664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:26.226665 5670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:26.226794 5656 server_base.cc:1034] running on GCE node
W20260810 01:37:26.226665 5665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:26.227557 5656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:26.228786 5656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:26.229987 5656 hybrid_clock.cc:648] HybridClock initialized: now 1786325846229958 us; error 42 us; skew 500 ppm
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:26.232967 5656 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:26.233898 5656 webserver.cc:460] Webserver started at http://127.24.205.190:42989/ using document root <none> and password file <none>
I20260810 01:37:26.234426 5656 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:26.234488 5656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:26.234658 5656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:26.236788 5656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "880b0139ff3d40a1b80c8959fc85d098"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "6a33b418b2ef159daca31d3f6e96c1f6"
server_key_iv: "2086c5cd6a23c1aec3052729307f4f1e"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.237311 5656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "880b0139ff3d40a1b80c8959fc85d098"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "6a33b418b2ef159daca31d3f6e96c1f6"
server_key_iv: "2086c5cd6a23c1aec3052729307f4f1e"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.241123 5656 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:37:26.243474 5682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:26.244763 5656 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:26.244899 5656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "880b0139ff3d40a1b80c8959fc85d098"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "6a33b418b2ef159daca31d3f6e96c1f6"
server_key_iv: "2086c5cd6a23c1aec3052729307f4f1e"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.245013 5656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:26.261998 5656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:26.265553 5656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:26.265791 5656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:26.273648 5656 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:44541
I20260810 01:37:26.273703 5760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:44541 every 8 connection(s)
I20260810 01:37:26.274654 5656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:26.277442 5761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:26.282102 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 5656
I20260810 01:37:26.282269 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:26.282585 25398 external_mini_cluster.cc:1428] Setting key 40199e3298c53fb78689371544bcebdc
I20260810 01:37:26.283268 5761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Bootstrap starting.
I20260810 01:37:26.285948 5761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:26.286847 5761 log.cc:824] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:26.288815 5761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: No bootstrap required, opened a new log
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:26.292580 5761 raft_consensus.cc:348] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:26.292889 5761 raft_consensus.cc:374] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:26.293001 5761 raft_consensus.cc:729] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880b0139ff3d40a1b80c8959fc85d098, State: Initialized, Role: FOLLOWER
I20260810 01:37:26.293521 5761 consensus_queue.cc:260] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:26.293697 5761 raft_consensus.cc:388] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:26.293792 5761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:26.293895 5761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:26.294723 5761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:26.295073 5761 leader_election.cc:302] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 880b0139ff3d40a1b80c8959fc85d098; no voters:
I20260810 01:37:26.295398 5761 leader_election.cc:288] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:26.295472 5770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:26.295701 5770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 LEADER]: Becoming Leader. State: Replica: 880b0139ff3d40a1b80c8959fc85d098, State: Running, Role: LEADER
I20260810 01:37:26.296042 5770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:26.296690 5761 sys_catalog.cc:564] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:26.297312 5770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 880b0139ff3d40a1b80c8959fc85d098. Latest consensus state: current_term: 1 leader_uuid: "880b0139ff3d40a1b80c8959fc85d098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } } }
I20260810 01:37:26.297435 5770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:26.297772 5771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "880b0139ff3d40a1b80c8959fc85d098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } } }
I20260810 01:37:26.297927 5771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:26.297947 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:26.284160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59608 (local address 127.24.205.190:44541)
0810 01:37:26.284605 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:26.284625 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:26.284668 (+ 43us) server_negotiation.cc:407] Connection header received
0810 01:37:26.285469 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:26.285495 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:26.285912 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:26.286303 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:26.287070 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.288034 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.288974 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.289469 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.289652 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:26.292231 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:26.292236 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:26.292249 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:26.292276 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:26.294246 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:26.294688 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:26.294694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:26.294700 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:26.294873 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:26.295165 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:26.295168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:26.295170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:26.295902 (+ 732us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:26.296196 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:26.296515 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 01:37:26.296863 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":122,"threads_started":1}
W20260810 01:37:26.301635 5787 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:37:26.301704 5787 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:37:26.301786 5774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:26.302465 5774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:26.307978 5774 catalog_manager.cc:1347] Generated new cluster ID: f7631c9e1d30458cb9363592f8537333
I20260810 01:37:26.308049 5774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:26.320794 5774 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:26.322057 5774 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:26.335831 5774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Generated new TSK 0
I20260810 01:37:26.336575 5774 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:37:26.375254 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44541
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:26.487675 5795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:26.487962 5795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:26.488037 5795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:26.491946 5795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:26.492033 5795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:26.492134 5795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:26.497493 5795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:26.498559 5795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:26.499637 5795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:26.509545 5811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:26.509559 5806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:26.509613 5804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:26.509779 5795 server_base.cc:1034] running on GCE node
I20260810 01:37:26.510303 5795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:26.510865 5795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:26.512130 5795 hybrid_clock.cc:648] HybridClock initialized: now 1786325846512090 us; error 47 us; skew 500 ppm
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:26.514883 5795 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:37:26.515717 5795 webserver.cc:460] Webserver started at http://127.24.205.129:33791/ using document root <none> and password file <none>
I20260810 01:37:26.516358 5795 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:26.516453 5795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:26.516691 5795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:26.518718 5795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "de21a7353af54313a50460c66a0b74a3"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "362bd0a571b8de9a2c97734e0ffdba36"
server_key_iv: "a0f7abd97cfe11ddbc654fab666968d0"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.519302 5795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "de21a7353af54313a50460c66a0b74a3"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "362bd0a571b8de9a2c97734e0ffdba36"
server_key_iv: "a0f7abd97cfe11ddbc654fab666968d0"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.522965 5795 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:37:26.525537 5818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:26.526796 5795 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:26.526963 5795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "de21a7353af54313a50460c66a0b74a3"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "362bd0a571b8de9a2c97734e0ffdba36"
server_key_iv: "a0f7abd97cfe11ddbc654fab666968d0"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.527084 5795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:26.538731 5795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:26.542210 5795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:26.542428 5795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:26.543048 5795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:26.543903 5795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:26.543979 5795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:26.544051 5795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:26.544138 5795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:26.553942 5795 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:37433
I20260810 01:37:26.553967 5990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:37433 every 8 connection(s)
I20260810 01:37:26.554920 5795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:26.561957 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 5795
I20260810 01:37:26.562135 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:26.562460 25398 external_mini_cluster.cc:1428] Setting key 1c01fa8f5b92f4b006bd596425d7901c
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:26.570125 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:26.556972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:35913 (local address 127.24.205.190:44541)
0810 01:37:26.557127 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:26.557130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:26.557996 (+ 866us) server_negotiation.cc:407] Connection header received
0810 01:37:26.559401 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:26.559404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:26.559463 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:26.559574 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:26.560862 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.561405 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.562748 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.563094 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.563218 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:26.566062 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:26.566068 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:26.566073 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:26.566109 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:26.567573 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:26.568231 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:26.568238 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:26.568243 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:26.568359 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:26.568722 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:26.568728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:26.568733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:26.568997 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:26.569108 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:26.569777 (+ 669us) server_negotiation.cc:299] Negotiation successful
0810 01:37:26.569925 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 01:37:26.570863 5993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:26.557371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:35913)
0810 01:37:26.557842 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:26.557885 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:26.559175 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:26.559756 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:26.559763 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:26.560214 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:26.560706 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:26.560720 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.561543 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.561552 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:26.562623 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:26.562634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.563259 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.563263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:26.563443 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:26.564158 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:26.564177 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:26.565890 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:26.567772 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:26.567777 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:26.567787 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:26.568129 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:26.568452 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:26.568454 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:26.568456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:26.568615 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:26.569138 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:26.569143 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:26.569390 (+ 247us) client_negotiation.cc:769] Sending connection context
0810 01:37:26.569667 (+ 277us) client_negotiation.cc:240] Negotiation successful
0810 01:37:26.569953 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":127,"threads_started":1}
I20260810 01:37:26.572121 5991 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44541
I20260810 01:37:26.572374 5991 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:26.572865 5991 heartbeater.cc:511] Master 127.24.205.190:44541 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:37:26.574486 5707 ts_manager.cc:194] Registered new tserver with Master: de21a7353af54313a50460c66a0b74a3 (127.24.205.129:37433)
I20260810 01:37:26.575757 5707 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:35913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:37:26.592765 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44541
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:26.705958 5999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:26.706275 5999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:26.706363 5999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:26.710335 5999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:26.710429 5999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:26.710523 5999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:26.715664 5999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:26.716717 5999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:26.717728 5999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:26.727121 6008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:26.727147 6009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:26.727151 6011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:26.727396 5999 server_base.cc:1034] running on GCE node
I20260810 01:37:26.727828 5999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:26.728650 5999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:26.729882 5999 hybrid_clock.cc:648] HybridClock initialized: now 1786325846729839 us; error 56 us; skew 500 ppm
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:26.733289 5999 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:37:26.734315 5999 webserver.cc:460] Webserver started at http://127.24.205.130:43453/ using document root <none> and password file <none>
I20260810 01:37:26.735059 5999 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:26.735160 5999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:26.735451 5999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:26.738400 5999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "381bf0248d6646a9adcbcd8a297fdb16"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "94c53b17a559a7f09f1c7d1a67185973"
server_key_iv: "765e30b06c63eb463da3e67934699413"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.739194 5999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "381bf0248d6646a9adcbcd8a297fdb16"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "94c53b17a559a7f09f1c7d1a67185973"
server_key_iv: "765e30b06c63eb463da3e67934699413"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.743124 5999 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 01:37:26.745850 6019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:26.747148 5999 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:26.747273 5999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "381bf0248d6646a9adcbcd8a297fdb16"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "94c53b17a559a7f09f1c7d1a67185973"
server_key_iv: "765e30b06c63eb463da3e67934699413"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.747385 5999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:26.762334 5999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:26.765316 5999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:26.765532 5999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:26.766146 5999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:26.767015 5999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:26.767074 5999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:26.767160 5999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:26.767194 5999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:26.776598 5999 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:44599
I20260810 01:37:26.776618 6208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:44599 every 8 connection(s)
I20260810 01:37:26.777616 5999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:26.779963 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 5999
I20260810 01:37:26.780143 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:26.780467 25398 external_mini_cluster.cc:1428] Setting key beef113d8f738ddab53657304d327359
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:37:26.792440 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:26.779516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:43747 (local address 127.24.205.190:44541)
0810 01:37:26.779668 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:26.779671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:26.780607 (+ 936us) server_negotiation.cc:407] Connection header received
0810 01:37:26.782082 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:26.782085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:26.782138 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:26.782231 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:26.783448 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.783992 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.785208 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.785455 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.785573 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:26.788430 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:26.788433 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:26.788435 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:26.788459 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:26.789887 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:26.790434 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:26.790438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:26.790439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:26.790517 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:26.790884 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:26.790887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:26.790889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:26.791120 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:26.791247 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:26.792146 (+ 899us) server_negotiation.cc:299] Negotiation successful
0810 01:37:26.792283 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:37:26.793308 6213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:26.779922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:43747)
0810 01:37:26.780445 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:26.780500 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:26.781856 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:26.782401 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:26.782408 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:26.782778 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:26.783296 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:26.783310 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.784157 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.784161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:26.785069 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:26.785079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:26.785615 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:26.785619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:26.785802 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:26.786461 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:26.786477 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:26.788248 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:26.790012 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:26.790018 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:26.790034 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:26.790307 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:26.790622 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:26.790625 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:26.790627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:26.790779 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:26.791234 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:26.791240 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:26.791549 (+ 309us) client_negotiation.cc:769] Sending connection context
0810 01:37:26.791838 (+ 289us) client_negotiation.cc:240] Negotiation successful
0810 01:37:26.792260 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":182,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:37:26.794703 6210 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44541
I20260810 01:37:26.794956 6210 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:26.795447 6210 heartbeater.cc:511] Master 127.24.205.190:44541 requested a full tablet report, sending...
I20260810 01:37:26.796530 5707 ts_manager.cc:194] Registered new tserver with Master: 381bf0248d6646a9adcbcd8a297fdb16 (127.24.205.130:44599)
I20260810 01:37:26.797374 5707 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:43747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:37:26.811396 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44541
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:26.940637 6218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:26.941110 6218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:26.941234 6218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:26.950964 6218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:26.951085 6218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:26.951256 6218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:26.965121 6218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:26.966851 6218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:26.968537 6218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:26.982278 6227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:26.982334 6226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:26.982328 6230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:26.982681 6218 server_base.cc:1034] running on GCE node
I20260810 01:37:26.983260 6218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:26.984231 6218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:26.985482 6218 hybrid_clock.cc:648] HybridClock initialized: now 1786325846985451 us; error 37 us; skew 500 ppm
Aug 10 01:37:26 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:26.989940 6218 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:37:26.990947 6218 webserver.cc:460] Webserver started at http://127.24.205.131:45399/ using document root <none> and password file <none>
I20260810 01:37:26.991540 6218 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:26.991603 6218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:26.991832 6218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:26.994022 6218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "48b2b6364e7e49c493bda5c6d941e3c4"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "e937169fc8564e83b469cf3bc5332cd3"
server_key_iv: "f76773176c2c606ed947b9d7bf00b4a9"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.994601 6218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "48b2b6364e7e49c493bda5c6d941e3c4"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "e937169fc8564e83b469cf3bc5332cd3"
server_key_iv: "f76773176c2c606ed947b9d7bf00b4a9"
server_key_version: "encryptionkey@0"
I20260810 01:37:26.998939 6218 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:27.001706 6245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.003062 6218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:37:27.003203 6218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "48b2b6364e7e49c493bda5c6d941e3c4"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "e937169fc8564e83b469cf3bc5332cd3"
server_key_iv: "f76773176c2c606ed947b9d7bf00b4a9"
server_key_version: "encryptionkey@0"
I20260810 01:37:27.003319 6218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:27.034310 6218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:27.037743 6218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:27.037963 6218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:27.038590 6218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:27.039577 6218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:27.039647 6218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.039721 6218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:27.039765 6218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.053004 6218 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:43155
I20260810 01:37:27.053018 6424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:43155 every 8 connection(s)
I20260810 01:37:27.054008 6218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:27.059976 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 6218
I20260810 01:37:27.060186 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:27.060534 25398 external_mini_cluster.cc:1428] Setting key c31d3cb5e27c64a99e43e511ef1906f9
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325846, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:27.071763 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.056183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:37441 (local address 127.24.205.190:44541)
0810 01:37:27.056327 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:27.056336 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:27.057517 (+ 1181us) server_negotiation.cc:407] Connection header received
0810 01:37:27.058956 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:27.058960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:27.059021 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:27.059146 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:27.060785 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.061867 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.063856 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.064342 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.064478 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.067177 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:27.067184 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:27.067189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:27.067228 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:27.069187 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:27.069726 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:27.069729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:27.069751 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:27.069906 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:27.070444 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:27.070449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:27.070451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:27.070785 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:27.070911 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:27.071406 (+ 495us) server_negotiation.cc:299] Negotiation successful
0810 01:37:27.071553 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:37:27.072603 6427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.056779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:37441)
0810 01:37:27.057347 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:27.057393 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:27.058718 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:27.059338 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:27.059345 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:27.059802 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:27.060574 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.060596 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.062592 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.062595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.063707 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.063727 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.064495 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.064498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.064650 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.065338 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:27.065355 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:27.066959 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:27.069321 (+ 2362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:27.069326 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:27.069339 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:27.069622 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:27.070138 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:27.070141 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:27.070143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:27.070320 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:27.070903 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:27.070908 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:27.071148 (+ 240us) client_negotiation.cc:769] Sending connection context
0810 01:37:27.071323 (+ 175us) client_negotiation.cc:240] Negotiation successful
0810 01:37:27.071592 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":154,"threads_started":1}
I20260810 01:37:27.074007 6425 heartbeater.cc:347] Connected to a master server at 127.24.205.190:44541
I20260810 01:37:27.074285 6425 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:27.074914 6425 heartbeater.cc:511] Master 127.24.205.190:44541 requested a full tablet report, sending...
I20260810 01:37:27.075991 5707 ts_manager.cc:194] Registered new tserver with Master: 48b2b6364e7e49c493bda5c6d941e3c4 (127.24.205.131:43155)
I20260810 01:37:27.076599 5707 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:37441
I20260810 01:37:27.086897 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab.
Entry for principal oryx/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab.
WARNING: no policy specified for oryx/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab.
Entry for principal oryx/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab.
WARNING: no policy specified for oryx/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab.
Entry for principal oryx/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab.
I20260810 01:37:27.168810 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 5795
I20260810 01:37:27.187172 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 5999
I20260810 01:37:27.223290 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 6218
I20260810 01:37:27.236725 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 5656
I20260810 01:37:27.248018 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44541
--webserver_interface=127.24.205.190
--webserver_port=42989
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:44541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:27.362954 6437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:27.363266 6437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:27.363341 6437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:27.367409 6437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:27.367504 6437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:27.367540 6437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:27.367580 6437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:27.367611 6437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:27.372861 6437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:44541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=42989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:27.373881 6437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:27.374886 6437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:27.383339 6454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:27.383353 6458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:27.383514 6437 server_base.cc:1034] running on GCE node
W20260810 01:37:27.383535 6453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:27.384305 6437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:27.385313 6437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:27.386487 6437 hybrid_clock.cc:648] HybridClock initialized: now 1786325847386466 us; error 30 us; skew 500 ppm
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325847, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:27.389439 6437 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:27.390311 6437 webserver.cc:460] Webserver started at http://127.24.205.190:42989/ using document root <none> and password file <none>
I20260810 01:37:27.390869 6437 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:27.390969 6437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:27.394771 6437 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:27.396914 6474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.398154 6437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:27.398319 6437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "880b0139ff3d40a1b80c8959fc85d098"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "6a33b418b2ef159daca31d3f6e96c1f6"
server_key_iv: "2086c5cd6a23c1aec3052729307f4f1e"
server_key_version: "encryptionkey@0"
I20260810 01:37:27.398867 6437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:27.420809 6437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:27.424250 6437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:27.424468 6437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:27.431936 6437 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:44541
I20260810 01:37:27.431952 6557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:44541 every 8 connection(s)
I20260810 01:37:27.433085 6437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:27.435021 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 6437
I20260810 01:37:27.435503 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:37433
--local_ip_for_outbound_sockets=127.24.205.129
--tserver_master_addrs=127.24.205.190:44541
--webserver_port=33791
--webserver_interface=127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:37:27.437814 6558 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:37:27.439934 6558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Bootstrap starting.
I20260810 01:37:27.456882 6558 log.cc:824] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:27.463711 6558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:37:27.464177 6558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Bootstrap complete.
I20260810 01:37:27.468490 6558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:27.468947 6558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880b0139ff3d40a1b80c8959fc85d098, State: Initialized, Role: FOLLOWER
I20260810 01:37:27.469444 6558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:27.469596 6558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:27.469684 6558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:27.469815 6558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:37:27.471746 6558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:27.472133 6558 leader_election.cc:302] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 880b0139ff3d40a1b80c8959fc85d098; no voters:
I20260810 01:37:27.472527 6558 leader_election.cc:288] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:37:27.472617 6562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:37:27.472812 6562 raft_consensus.cc:686] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [term 2 LEADER]: Becoming Leader. State: Replica: 880b0139ff3d40a1b80c8959fc85d098, State: Running, Role: LEADER
I20260810 01:37:27.473124 6562 consensus_queue.cc:237] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } }
I20260810 01:37:27.473790 6558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:27.474063 6562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 880b0139ff3d40a1b80c8959fc85d098. Latest consensus state: current_term: 2 leader_uuid: "880b0139ff3d40a1b80c8959fc85d098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } } }
I20260810 01:37:27.474188 6562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:27.474553 6569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:27.474598 6565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "880b0139ff3d40a1b80c8959fc85d098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "880b0139ff3d40a1b80c8959fc85d098" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44541 } } }
I20260810 01:37:27.474807 6565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:27.477967 6569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:27.478607 6569 catalog_manager.cc:1259] Loaded cluster ID: f7631c9e1d30458cb9363592f8537333
I20260810 01:37:27.478673 6569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:27.481099 6569 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:27.481781 6569 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 880b0139ff3d40a1b80c8959fc85d098: Loaded TSK: 0
I20260810 01:37:27.482990 6569 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:37:27.554240 6560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:27.554545 6560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:27.554622 6560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:27.558698 6560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:27.558785 6560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:27.558878 6560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:27.564306 6560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.129.keytab
--principal=oryx/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:37433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=33791
--tserver_master_addrs=127.24.205.190:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:27.565335 6560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:27.566344 6560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:27.576488 6599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:27.576637 6601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:27.576504 6598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:27.576843 6560 server_base.cc:1034] running on GCE node
I20260810 01:37:27.577311 6560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:27.577991 6560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:27.579197 6560 hybrid_clock.cc:648] HybridClock initialized: now 1786325847579165 us; error 47 us; skew 500 ppm
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325847, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:27.582460 6560 init.cc:377] Logged in from keytab as oryx/127.24.205.129@KRBTEST.COM (short username oryx)
I20260810 01:37:27.583478 6560 webserver.cc:460] Webserver started at http://127.24.205.129:33791/ using document root <none> and password file <none>
I20260810 01:37:27.584035 6560 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:27.584203 6560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:27.588287 6560 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:27.590487 6618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.591775 6560 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:37:27.591868 6560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "de21a7353af54313a50460c66a0b74a3"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "362bd0a571b8de9a2c97734e0ffdba36"
server_key_iv: "a0f7abd97cfe11ddbc654fab666968d0"
server_key_version: "encryptionkey@0"
I20260810 01:37:27.592499 6560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:27.606206 6560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:27.609612 6560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:27.609827 6560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:27.610514 6560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:27.611436 6560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:27.611486 6560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.611558 6560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:27.611589 6560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.621886 6560 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:37433
I20260810 01:37:27.621907 6793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:37433 every 8 connection(s)
I20260810 01:37:27.622965 6560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:27.623713 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 6560
I20260810 01:37:27.624295 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:44599
--local_ip_for_outbound_sockets=127.24.205.130
--tserver_master_addrs=127.24.205.190:44541
--webserver_port=43453
--webserver_interface=127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:27.637771 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.625473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:40035)
0810 01:37:27.626475 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:27.626517 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:27.627820 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:27.629037 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:27.629046 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:27.629499 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:27.629968 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.629983 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.631469 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.631477 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.632542 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.632553 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.633376 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.633381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.633579 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.634231 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:27.634248 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:27.636752 (+ 2504us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":834,"thread_start_us":127,"threads_started":1}
W20260810 01:37:27.637763 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:27.625393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:40035 (local address 127.24.205.190:44541)
0810 01:37:27.625961 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:27.625984 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:27.626651 (+ 667us) server_negotiation.cc:407] Connection header received
0810 01:37:27.628281 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:27.628292 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:27.628594 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:27.628951 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:27.630158 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.631314 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.632681 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.633192 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.633389 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.636984 (+ 3595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:40035: BlockingRecv error: recv got EOF from 127.24.205.129:40035 (error 108)
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":138,"threads_started":1}
W20260810 01:37:27.638451 6794 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:44541 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.205.190:44541: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:27.644567 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.638904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:43069)
0810 01:37:27.639044 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:27.639059 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:27.639148 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:27.639420 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:27.639423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:27.639606 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:27.639720 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.639726 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.640494 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.640498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.641387 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.641397 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.641821 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.641827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.641991 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.642465 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:27.642480 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:27.644412 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260810 01:37:27.644661 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:27.639027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:43069 (local address 127.24.205.190:44541)
0810 01:37:27.639134 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:27.639137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:27.639150 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:27.639252 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:27.639254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:27.639293 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:27.639361 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:27.639833 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.640388 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.641503 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.641707 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.641784 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.644544 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:43069: BlockingRecv error: recv got EOF from 127.24.205.129:43069 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:27.650533 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.645093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:49827)
0810 01:37:27.645202 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:27.645218 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:27.645298 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:27.645684 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:27.645686 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:27.645813 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:27.645885 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.645890 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.646908 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.646911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.647431 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.647439 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.648009 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.648012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.648143 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.648614 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:27.648626 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:27.650411 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 01:37:27.650652 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:27.645308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:49827 (local address 127.24.205.190:44541)
0810 01:37:27.645438 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:27.645443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:27.645456 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:27.645500 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:27.645502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:27.645544 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:27.645634 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:27.645998 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.646778 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.647552 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.647874 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.647985 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.650527 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:49827: BlockingRecv error: recv got EOF from 127.24.205.129:49827 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 01:37:27.651010 6794 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:37:27.743469 6799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:27.743798 6799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:27.743884 6799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:27.747944 6799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:27.748046 6799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:27.748159 6799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:27.753495 6799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.130.keytab
--principal=oryx/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:44599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=43453
--tserver_master_addrs=127.24.205.190:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:27.754628 6799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:27.755714 6799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:27.765509 6806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:27.765511 6809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:27.765511 6814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:27.765568 6799 server_base.cc:1034] running on GCE node
I20260810 01:37:27.766155 6799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:27.766724 6799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:27.767930 6799 hybrid_clock.cc:648] HybridClock initialized: now 1786325847767901 us; error 42 us; skew 500 ppm
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325847, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:27.770857 6799 init.cc:377] Logged in from keytab as oryx/127.24.205.130@KRBTEST.COM (short username oryx)
I20260810 01:37:27.771868 6799 webserver.cc:460] Webserver started at http://127.24.205.130:43453/ using document root <none> and password file <none>
I20260810 01:37:27.772583 6799 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:27.772662 6799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:27.776765 6799 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:27.778950 6823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.780426 6799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:37:27.780570 6799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "381bf0248d6646a9adcbcd8a297fdb16"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "94c53b17a559a7f09f1c7d1a67185973"
server_key_iv: "765e30b06c63eb463da3e67934699413"
server_key_version: "encryptionkey@0"
I20260810 01:37:27.781159 6799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:27.803025 6799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:27.806449 6799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:27.806681 6799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:27.807313 6799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:27.808219 6799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:27.808290 6799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.808357 6799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:27.808409 6799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.817632 6799 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:44599
I20260810 01:37:27.817655 6996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:44599 every 8 connection(s)
I20260810 01:37:27.818660 6799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:27.822705 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 6799
I20260810 01:37:27.823186 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:43155
--local_ip_for_outbound_sockets=127.24.205.131
--tserver_master_addrs=127.24.205.190:44541
--webserver_port=45399
--webserver_interface=127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:37:27.830786 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:27.820534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:46929 (local address 127.24.205.190:44541)
0810 01:37:27.820673 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:27.820677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:27.821537 (+ 860us) server_negotiation.cc:407] Connection header received
0810 01:37:27.822907 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:27.822910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:27.822978 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:27.823093 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:27.824444 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.825180 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.826390 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.826785 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.826914 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.830615 (+ 3701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:46929: BlockingRecv error: recv got EOF from 127.24.205.130:46929 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:37:27.831226 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.820931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:46929)
0810 01:37:27.821381 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:27.821424 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:27.822642 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:27.823328 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:27.823341 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:27.823734 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:27.824289 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.824305 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.825338 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.825341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.826249 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.826259 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.826941 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.826943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.827092 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.827708 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:27.827724 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:27.830392 (+ 2668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":119,"threads_started":1}
W20260810 01:37:27.831848 6997 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:44541 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.205.190:44541: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:27.837350 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.832366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:42025)
0810 01:37:27.832460 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:27.832476 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:27.832551 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:27.832798 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:27.832801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:27.832964 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:27.833064 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.833069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.833795 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.833800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.834338 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.834345 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.834799 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.834803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.834894 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.835440 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:27.835452 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:27.837265 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 01:37:27.837730 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:27.832466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:42025 (local address 127.24.205.190:44541)
0810 01:37:27.832583 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:27.832588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:27.832604 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:37:27.832644 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:27.832647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:27.832691 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:27.832783 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:27.833180 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.833684 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.834463 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.834685 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.834799 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.837424 (+ 2625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:42025: BlockingRecv error: recv got EOF from 127.24.205.130:42025 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:27.843063 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:27.837847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:33015)
0810 01:37:27.838008 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:27.838023 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:27.838105 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:27.838368 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:27.838370 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:27.838495 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:27.838563 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.838568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.839553 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.839555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.840053 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:27.840112 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.840698 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.840701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:27.840764 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.841237 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:27.841248 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:27.842981 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260810 01:37:27.843266 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:27.837913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:33015 (local address 127.24.205.190:44541)
0810 01:37:27.838025 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:27.838029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:27.838070 (+ 41us) server_negotiation.cc:407] Connection header received
0810 01:37:27.838192 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:27.838195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:27.838248 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:27.838332 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:27.838665 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.839450 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.840225 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:27.840571 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:27.840674 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:27.843142 (+ 2468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:33015: BlockingRecv error: recv got EOF from 127.24.205.130:33015 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 01:37:27.843456 6997 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:37:27.945899 7003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:27.946161 7003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:27.946204 7003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:27.950233 7003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:27.950295 7003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:27.950414 7003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:27.955688 7003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/krb5kdc/oryx_127.24.205.131.keytab
--principal=oryx/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:43155
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=45399
--tserver_master_addrs=127.24.205.190:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:27.956795 7003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:27.957846 7003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:27.967971 7018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:27.967971 7015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:27.968006 7016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:27.968459 7003 server_base.cc:1034] running on GCE node
I20260810 01:37:27.968852 7003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:27.969429 7003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:27.970625 7003 hybrid_clock.cc:648] HybridClock initialized: now 1786325847970611 us; error 38 us; skew 500 ppm
Aug 10 01:37:27 dist-test-slave-t3q3 krb5kdc[5638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325847, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:27.973608 7003 init.cc:377] Logged in from keytab as oryx/127.24.205.131@KRBTEST.COM (short username oryx)
I20260810 01:37:27.974582 7003 webserver.cc:460] Webserver started at http://127.24.205.131:45399/ using document root <none> and password file <none>
I20260810 01:37:27.975261 7003 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:27.975345 7003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:27.979528 7003 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:37:27.981885 7032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:27.983198 7003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:37:27.983310 7003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "48b2b6364e7e49c493bda5c6d941e3c4"
format_stamp: "Formatted at 2026-08-10 01:37:26 on dist-test-slave-t3q3"
server_key: "e937169fc8564e83b469cf3bc5332cd3"
server_key_iv: "f76773176c2c606ed947b9d7bf00b4a9"
server_key_version: "encryptionkey@0"
I20260810 01:37:27.983965 7003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:28.000277 7003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:28.004102 7003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:28.004329 7003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:28.004981 7003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:28.005856 7003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:28.005911 7003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:28.005997 7003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:28.006036 7003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:28.014789 7003 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:43155
I20260810 01:37:28.014853 7202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:43155 every 8 connection(s)
I20260810 01:37:28.015834 7003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:28.021339 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 7003
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:37:28.027725 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:28.017671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:41647 (local address 127.24.205.190:44541)
0810 01:37:28.017841 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:28.017846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:28.018732 (+ 886us) server_negotiation.cc:407] Connection header received
0810 01:37:28.020042 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:28.020045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:28.020159 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:28.020236 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:28.021413 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.022143 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.023459 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.023801 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.023921 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.027611 (+ 3690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:41647: BlockingRecv error: recv got EOF from 127.24.205.131:41647 (error 108)
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":73}
I20260810 01:37:28.028601 7209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:28.018130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:41647)
0810 01:37:28.018576 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:28.018619 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:28.019835 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:28.020412 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:28.020418 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:28.020773 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:28.021251 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.021264 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.022324 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.022328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.023322 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.023332 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.023963 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.023967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.024203 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.024809 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:28.024826 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:28.027479 (+ 2653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
W20260810 01:37:28.029074 7207 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:44541 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.205.190:44541: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
I20260810 01:37:28.031502 7213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:28.022361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59610 (local address 127.24.205.190:44541)
0810 01:37:28.022614 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:28.022618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:28.022629 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:37:28.022657 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:28.022659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:28.022691 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:28.022787 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:28.023521 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.024180 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.025056 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.025296 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.025404 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.026885 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:28.026894 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:28.026916 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:28.026950 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:28.029128 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:28.029753 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:28.029760 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:28.029766 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:28.029901 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:28.030204 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:28.030208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:28.030210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:28.030572 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:28.030800 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:28.031105 (+ 305us) server_negotiation.cc:299] Negotiation successful
0810 01:37:28.031385 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":190,"thread_start_us":86,"threads_started":1}
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:28.034988 7209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:28.029537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:35365)
0810 01:37:28.029783 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:28.029796 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:28.029878 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:28.030116 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:28.030119 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:28.030281 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:28.030367 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.030372 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.031078 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.031082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.031831 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.031840 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.032358 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.032361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.032454 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.032851 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:28.032864 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:28.034851 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181}
W20260810 01:37:28.035066 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:28.029664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:35365 (local address 127.24.205.190:44541)
0810 01:37:28.029762 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:28.029766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:28.029837 (+ 71us) server_negotiation.cc:407] Connection header received
0810 01:37:28.029968 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:28.029971 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:28.030017 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:28.030100 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:28.030480 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.030971 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.031955 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.032248 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.032356 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.034956 (+ 2600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:35365: BlockingRecv error: recv got EOF from 127.24.205.131:35365 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:28.040232 7209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:28.035505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:52909)
0810 01:37:28.035618 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:28.035632 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:28.035721 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:28.035949 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:28.035951 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:28.036162 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:28.036233 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.036239 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.036933 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.036938 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.037442 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.037450 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.037893 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.037897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.037976 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.038427 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:28.038439 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:28.040100 (+ 1661us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 01:37:28.040324 6797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:28.035591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:52909 (local address 127.24.205.190:44541)
0810 01:37:28.035754 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:28.035760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:28.035775 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:28.035816 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:28.035818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:28.035849 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:28.035933 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:28.036345 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.036822 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.037564 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.037780 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.037890 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.040208 (+ 2318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:52909: BlockingRecv error: recv got EOF from 127.24.205.131:52909 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260810 01:37:28.040524 7207 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:28.660363 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:28.651585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:57333)
0810 01:37:28.651876 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:28.651896 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:28.651985 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:28.652234 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:28.652236 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:28.652417 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:28.652513 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.652518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.653253 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.653256 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.653829 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.653837 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.654246 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.654248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.654308 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.658331 (+ 4023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:28.658343 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:28.660237 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":74,"threads_started":1}
W20260810 01:37:28.660517 7218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:28.651675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:57333 (local address 127.24.205.190:44541)
0810 01:37:28.651970 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:28.651974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:28.651987 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:28.652071 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:28.652073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:28.652115 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:28.652189 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:28.652616 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.653160 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.653930 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.654149 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.654236 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.660382 (+ 6146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:57333: BlockingRecv error: recv got EOF from 127.24.205.129:57333 (error 108)
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":107,"threads_started":1}
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:28 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:28.850066 7219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:28.844186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:50295)
0810 01:37:28.844510 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:28.844530 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:28.844660 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:28.844943 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:28.844946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:28.845171 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:28.845268 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.845274 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.846075 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.846079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.846677 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:28.846685 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.847169 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.847173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:28.847263 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.847858 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:28.847870 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:28.849889 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":88,"threads_started":1}
W20260810 01:37:28.850147 7218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:28.844244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:50295 (local address 127.24.205.190:44541)
0810 01:37:28.844443 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:28.844448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:28.844596 (+ 148us) server_negotiation.cc:407] Connection header received
0810 01:37:28.844768 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:28.844771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:28.844821 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:28.844917 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:28.845396 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.845959 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.846805 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:28.847050 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:28.847165 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:28.850027 (+ 2862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:50295: BlockingRecv error: recv got EOF from 127.24.205.130:50295 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 01:37:29 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:29 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:29.047065 7221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:29.041239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:49335)
0810 01:37:29.041649 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:29.041668 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:29.041792 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:29.042087 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:29.042090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:29.042340 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:29.042501 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:29.042509 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.043288 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.043291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:29.043904 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:29.043913 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.044386 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.044389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:29.044464 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:29.045053 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:29.045067 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:29.046920 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":104,"threads_started":1}
W20260810 01:37:29.047181 7218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:29.041303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:49335 (local address 127.24.205.190:44541)
0810 01:37:29.041458 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:29.041462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:29.041759 (+ 297us) server_negotiation.cc:407] Connection header received
0810 01:37:29.041895 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:29.041900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:29.041959 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:29.042033 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:29.042631 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.043167 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.044023 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.044282 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.044366 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:29.047062 (+ 2696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:49335: BlockingRecv error: recv got EOF from 127.24.205.131:49335 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 01:37:29 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:29 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:29.666824 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:29.661283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:33233)
0810 01:37:29.661585 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:29.661600 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:29.661707 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:29.661972 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:29.661974 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:29.662174 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:29.662280 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:29.662285 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.663031 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.663034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:29.663659 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:29.663668 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.664170 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.664173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:29.664241 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:29.664727 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:29.664740 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:29.666685 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":94,"threads_started":1}
W20260810 01:37:29.667021 7224 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:29.661343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:33233 (local address 127.24.205.190:44541)
0810 01:37:29.661605 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:29.661608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:29.661655 (+ 47us) server_negotiation.cc:407] Connection header received
0810 01:37:29.661798 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:29.661800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:29.661846 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:29.661923 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:29.662387 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.662919 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.663766 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.663989 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.664084 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:29.666860 (+ 2776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:33233: BlockingRecv error: recv got EOF from 127.24.205.129:33233 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":67,"threads_started":1}
Aug 10 01:37:29 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:29 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:29.856684 7226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:29.850958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:35845)
0810 01:37:29.851310 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:29.851324 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:29.851424 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:29.851660 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:29.851662 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:29.851858 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:29.851957 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:29.851962 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.852762 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.852764 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:29.853344 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:29.853352 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.853809 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.853812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:29.853875 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:29.854366 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:29.854377 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:29.856485 (+ 2108us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":112,"threads_started":1}
W20260810 01:37:29.856884 7224 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:29.851090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:35845 (local address 127.24.205.190:44541)
0810 01:37:29.851246 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:29.851250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:29.851393 (+ 143us) server_negotiation.cc:407] Connection header received
0810 01:37:29.851506 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:29.851509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:29.851557 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:29.851621 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:29.852111 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.852656 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.853465 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:29.853702 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:29.853789 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:29.856667 (+ 2878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:35845: BlockingRecv error: recv got EOF from 127.24.205.130:35845 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 01:37:30 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:30 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:30.054076 7227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:30.047947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:58057)
0810 01:37:30.048270 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:30.048306 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:30.048423 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:30.048716 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:30.048719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:30.048950 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:30.049050 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:30.049055 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.049886 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.049891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:30.050482 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:30.050499 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.050973 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.050977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:30.051059 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:30.051675 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:30.051688 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:30.053869 (+ 2181us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":107,"threads_started":1}
W20260810 01:37:30.054180 7224 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:30.048253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:58057 (local address 127.24.205.190:44541)
0810 01:37:30.048401 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:30.048406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:30.048420 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:37:30.048528 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:30.048533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:30.048592 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:30.048689 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:30.049178 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.049763 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.050621 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.050852 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.050967 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:30.054056 (+ 3089us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:58057: BlockingRecv error: recv got EOF from 127.24.205.131:58057 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 01:37:30 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:30 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:37:30.673841 7230 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:30.667836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:42631 (local address 127.24.205.190:44541)
0810 01:37:30.668188 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:30.668192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:30.668207 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:30.668356 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:30.668360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:30.668413 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:30.668513 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:30.668964 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.669562 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.670333 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.670583 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.670668 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:30.673704 (+ 3036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:42631: BlockingRecv error: recv got EOF from 127.24.205.129:42631 (error 108)
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":71,"threads_started":1}
I20260810 01:37:30.673969 7229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:30.667751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:42631)
0810 01:37:30.668102 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:30.668117 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:30.668214 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:30.668550 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:30.668552 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:30.668744 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:30.668848 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:30.668853 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.669660 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.669663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:30.670221 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:30.670228 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.670686 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.670688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:30.670760 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:30.671372 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:30.671385 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:30.673571 (+ 2186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":110,"threads_started":1}
Aug 10 01:37:30 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:30 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:30.863005 7232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:30.857478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:52545)
0810 01:37:30.857757 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:30.857771 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:30.857876 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:30.858129 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:30.858131 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:30.858317 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:30.858419 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:30.858424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.859173 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.859175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:30.859720 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:30.859727 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.860232 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.860237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:30.860340 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:30.860856 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:30.860868 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:30.862789 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":75,"threads_started":1}
W20260810 01:37:30.863044 7230 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:30.857576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:52545 (local address 127.24.205.190:44541)
0810 01:37:30.857773 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:30.857777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:30.857840 (+ 63us) server_negotiation.cc:407] Connection header received
0810 01:37:30.857961 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:30.857964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:30.858010 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:30.858078 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:30.858528 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.859076 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.859821 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:30.860035 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:30.860203 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:30.862932 (+ 2729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:52545: BlockingRecv error: recv got EOF from 127.24.205.130:52545 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 10 01:37:31 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:31 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:31.061551 7235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:31.055098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:48815)
0810 01:37:31.055397 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:31.055414 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:31.055551 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:31.055815 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:31.055817 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:31.055999 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:31.056179 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:31.056188 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.057051 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.057057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:31.057701 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:31.057711 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.058233 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.058237 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:31.058328 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:31.058929 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:31.058942 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:31.061380 (+ 2438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":127,"threads_started":1}
W20260810 01:37:31.061653 7230 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:31.055249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:48815 (local address 127.24.205.190:44541)
0810 01:37:31.055399 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:31.055404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:31.055500 (+ 96us) server_negotiation.cc:407] Connection header received
0810 01:37:31.055631 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:31.055633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:31.055688 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:31.055776 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:31.056328 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.056918 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.057839 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.058102 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.058225 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:31.061529 (+ 3304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:48815: BlockingRecv error: recv got EOF from 127.24.205.131:48815 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 01:37:31 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:31 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:31.680393 7236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:31.674776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:48915)
0810 01:37:31.675167 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:31.675186 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:31.675317 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:31.675599 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:31.675602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:31.675792 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:31.675908 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:31.675913 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.676682 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.676685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:31.677273 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:31.677282 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.677717 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.677719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:31.677786 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:31.678382 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:31.678394 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:31.680277 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":125,"threads_started":1}
W20260810 01:37:31.680552 7239 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:31.674845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:48915 (local address 127.24.205.190:44541)
0810 01:37:31.675151 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:31.675155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:31.675250 (+ 95us) server_negotiation.cc:407] Connection header received
0810 01:37:31.675396 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:31.675398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:31.675441 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:31.675519 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:31.676001 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.676573 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.677383 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.677616 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.677693 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:31.680414 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:48915: BlockingRecv error: recv got EOF from 127.24.205.129:48915 (error 108)
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":108,"threads_started":1}
Aug 10 01:37:31 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:31 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:31.869604 7240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:31.863792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:42417)
0810 01:37:31.864128 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:31.864142 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:31.864244 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:31.864511 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:31.864514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:31.864707 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:31.864814 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:31.864819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.865662 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.865665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:31.866245 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:31.866254 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.866714 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.866717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:31.866786 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:31.867459 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:31.867486 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:31.869487 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":118,"threads_started":1}
W20260810 01:37:31.869776 7239 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:31.863872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:42417 (local address 127.24.205.190:44541)
0810 01:37:31.864023 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:31.864026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:31.864201 (+ 175us) server_negotiation.cc:407] Connection header received
0810 01:37:31.864313 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:31.864316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:31.864362 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:31.864433 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:31.864974 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.865546 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.866365 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:31.866601 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:31.866688 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:31.869643 (+ 2955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:42417: BlockingRecv error: recv got EOF from 127.24.205.130:42417 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 01:37:32 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:32 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:32.068912 7241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:32.062765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:47555)
0810 01:37:32.063133 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:32.063149 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:32.063268 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:32.063554 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:32.063557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:32.063760 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:32.063868 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:32.063873 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.064723 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.064726 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:32.065302 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:32.065310 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.065846 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.065849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:32.065921 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:32.066500 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:32.066513 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:32.068706 (+ 2193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":104,"threads_started":1}
W20260810 01:37:32.069002 7239 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:32.062880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:47555 (local address 127.24.205.190:44541)
0810 01:37:32.063123 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:32.063127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:32.063209 (+ 82us) server_negotiation.cc:407] Connection header received
0810 01:37:32.063344 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:32.063347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:32.063394 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:32.063472 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:32.064025 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.064611 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.065439 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.065701 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.065804 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:32.068861 (+ 3057us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:47555: BlockingRecv error: recv got EOF from 127.24.205.131:47555 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 10 01:37:32 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:32 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:32.687178 7242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:32.681245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:55641)
0810 01:37:32.681577 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:32.681591 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:32.681710 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:32.681957 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:32.681959 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:32.682151 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:32.682265 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:32.682271 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.683179 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.683181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:32.683774 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:32.683782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.684450 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.684453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:32.684522 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:32.685025 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:32.685037 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:32.686995 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":112,"threads_started":1}
W20260810 01:37:32.687260 7244 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:32.681309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:55641 (local address 127.24.205.190:44541)
0810 01:37:32.681608 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:32.681612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:32.681642 (+ 30us) server_negotiation.cc:407] Connection header received
0810 01:37:32.681782 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:32.681784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:32.681829 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:32.681906 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:32.682390 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.683062 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.684000 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.684331 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.684431 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:32.687131 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:55641: BlockingRecv error: recv got EOF from 127.24.205.129:55641 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":103,"threads_started":1}
Aug 10 01:37:32 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:32 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:32.876271 7246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:32.870492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:48609)
0810 01:37:32.870801 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:32.870815 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:32.870909 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:32.871123 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:32.871125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:32.871326 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:32.871425 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:32.871430 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.872256 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.872258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:32.872833 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:32.872841 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.873266 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.873269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:32.873333 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:32.873936 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:32.873948 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:32.876081 (+ 2133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":84,"threads_started":1}
W20260810 01:37:32.876398 7244 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:32.870617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:48609 (local address 127.24.205.190:44541)
0810 01:37:32.870780 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:32.870784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:32.870877 (+ 93us) server_negotiation.cc:407] Connection header received
0810 01:37:32.870974 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:32.870976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:32.871021 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:32.871088 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:32.871522 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.872054 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.872933 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:32.873170 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:32.873246 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:32.876257 (+ 3011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:48609: BlockingRecv error: recv got EOF from 127.24.205.130:48609 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 01:37:33 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:33 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:33.075794 7248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:33.069892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:59017)
0810 01:37:33.070165 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:33.070179 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:33.070292 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:33.070537 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:33.070539 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:33.070730 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:33.070827 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:33.070832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.071607 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.071609 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:33.072283 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:33.072293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.072724 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.072727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:33.072788 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:33.073420 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:33.073432 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:33.075603 (+ 2171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":101,"threads_started":1}
W20260810 01:37:33.075860 7244 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:33.070048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:59017 (local address 127.24.205.190:44541)
0810 01:37:33.070187 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:33.070191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:33.070258 (+ 67us) server_negotiation.cc:407] Connection header received
0810 01:37:33.070374 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:33.070376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:33.070424 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:33.070501 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:33.070958 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.071504 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.072392 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.072620 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.072706 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:33.075742 (+ 3036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:59017: BlockingRecv error: recv got EOF from 127.24.205.131:59017 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 01:37:33 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:33 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:33.698997 7249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:33.688182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:58167)
0810 01:37:33.688483 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:33.688498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:33.688603 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:33.688954 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:33.688957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:33.689198 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:33.689307 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:33.689313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.690293 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.690296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:33.690874 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:33.690882 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.691421 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.691424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:33.691489 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:33.696947 (+ 5458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:33.696960 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:33.698875 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":106,"threads_started":1}
W20260810 01:37:33.699235 7252 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:33.688272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:58167 (local address 127.24.205.190:44541)
0810 01:37:33.688513 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:33.688516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:33.688550 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:37:33.688740 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:33.688743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:33.688800 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:33.688901 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:33.689471 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.690169 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.691027 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.691304 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.691403 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:33.699057 (+ 7654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:58167: BlockingRecv error: recv got EOF from 127.24.205.129:58167 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
Aug 10 01:37:33 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:33 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:33.883167 7253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:33.877404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:39819)
0810 01:37:33.877687 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:33.877701 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:33.877797 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:33.878046 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:33.878048 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:33.878236 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:33.878336 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:33.878341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.879246 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.879251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:33.879903 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:33.879922 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.880469 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.880473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:33.880562 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:33.881103 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:33.881115 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:33.882990 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":74,"threads_started":1}
W20260810 01:37:33.883245 7252 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:33.877552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:39819 (local address 127.24.205.190:44541)
0810 01:37:33.877725 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:33.877728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:33.877746 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:37:33.877887 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:33.877889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:33.877935 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:33.878004 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:33.878455 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.879140 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.880034 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:33.880345 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:33.880461 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:33.883126 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:39819: BlockingRecv error: recv got EOF from 127.24.205.130:39819 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 10 01:37:34 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:34 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:34.082118 7254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:34.076777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:36499)
0810 01:37:34.077071 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:34.077085 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:34.077196 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:34.077424 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:34.077426 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:34.077614 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:34.077712 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:34.077717 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.078460 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.078466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:34.079079 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:34.079089 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.079600 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.079604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:34.079680 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:34.080195 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:34.080207 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:34.082005 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":95,"threads_started":1}
W20260810 01:37:34.082317 7252 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:34.076891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:36499 (local address 127.24.205.190:44541)
0810 01:37:34.077080 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:34.077085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:34.077137 (+ 52us) server_negotiation.cc:407] Connection header received
0810 01:37:34.077268 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:34.077270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:34.077317 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:34.077386 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:34.077818 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.078347 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.079234 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.079475 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.079599 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:34.082154 (+ 2555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:36499: BlockingRecv error: recv got EOF from 127.24.205.131:36499 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 10 01:37:34 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:34 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:34.705740 7258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:34.699732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:39093)
0810 01:37:34.700161 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:34.700176 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:34.700284 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:34.700527 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:34.700529 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:34.700725 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:34.700827 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:34.700832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.701632 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.701634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:34.702180 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:34.702187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.702677 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.702680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:34.702748 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:34.703301 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:34.703312 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:34.705562 (+ 2250us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":93,"threads_started":1}
W20260810 01:37:34.705799 7260 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:34.699867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:39093 (local address 127.24.205.190:44541)
0810 01:37:34.700172 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:34.700176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:34.700254 (+ 78us) server_negotiation.cc:407] Connection header received
0810 01:37:34.700364 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:34.700367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:34.700411 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:34.700488 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:34.700929 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.701534 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.702281 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.702574 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.702656 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:34.705681 (+ 3025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:39093: BlockingRecv error: recv got EOF from 127.24.205.129:39093 (error 108)
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":96,"threads_started":1}
Aug 10 01:37:34 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:34 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:34.889792 7263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:34.883957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:56305)
0810 01:37:34.884337 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:34.884358 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:34.884459 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:34.884718 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:34.884720 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:34.884903 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:34.885007 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:34.885012 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.885830 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.885833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:34.886394 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:34.886402 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.886859 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.886861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:34.886926 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:34.887532 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:34.887543 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:34.889604 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":121,"threads_started":1}
W20260810 01:37:34.889832 7260 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:34.884115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:56305 (local address 127.24.205.190:44541)
0810 01:37:34.884293 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:34.884297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:34.884438 (+ 141us) server_negotiation.cc:407] Connection header received
0810 01:37:34.884549 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:34.884552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:34.884600 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:34.884663 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:34.885117 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.885728 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.886519 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:34.886751 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:34.886840 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:34.889732 (+ 2892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:56305: BlockingRecv error: recv got EOF from 127.24.205.130:56305 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 01:37:35 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:35 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:35.088861 7264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:35.082858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:48893)
0810 01:37:35.083202 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:35.083216 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:35.083351 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:35.083651 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:35.083654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:35.083885 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:35.083979 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:35.083985 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.084876 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.084882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:35.085469 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:35.085479 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.085957 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.085961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:35.086049 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:35.086616 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:35.086629 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:35.088678 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":93,"threads_started":1}
W20260810 01:37:35.088901 7260 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:35.082931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:48893 (local address 127.24.205.190:44541)
0810 01:37:35.083093 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:35.083098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:35.083299 (+ 201us) server_negotiation.cc:407] Connection header received
0810 01:37:35.083472 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:35.083475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:35.083533 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:35.083624 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:35.084122 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.084738 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.085601 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.085836 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.085952 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:35.088800 (+ 2848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:48893: BlockingRecv error: recv got EOF from 127.24.205.131:48893 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 01:37:35 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:35 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:35.712272 7266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:35.706637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:49503)
0810 01:37:35.706973 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:35.706991 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:35.707102 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:35.707417 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:35.707420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:35.707672 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:35.707785 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:35.707791 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.708631 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.708633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:35.709203 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:35.709211 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.709665 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.709668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:35.709730 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:35.710224 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:35.710235 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:35.712151 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":90,"threads_started":1}
W20260810 01:37:35.712406 7267 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:35.706850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:49503 (local address 127.24.205.190:44541)
0810 01:37:35.707115 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:35.707119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:35.707137 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:37:35.707212 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:35.707216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:35.707269 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:35.707371 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:35.707905 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.708528 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.709324 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.709554 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.709638 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:35.712270 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:49503: BlockingRecv error: recv got EOF from 127.24.205.129:49503 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":81,"threads_started":1}
Aug 10 01:37:35 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:35 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:35.897651 7268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:35.890584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:56123)
0810 01:37:35.890859 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:35.890873 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:35.890975 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:35.891285 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:35.891288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:35.891528 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:35.891661 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:35.891671 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.893157 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.893161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:35.893960 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:35.893973 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.894452 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.894457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:35.894548 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:35.895157 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:35.895175 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:35.897533 (+ 2358us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":111,"threads_started":1}
W20260810 01:37:35.897794 7267 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:35.890711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:56123 (local address 127.24.205.190:44541)
0810 01:37:35.890858 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:35.890862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:35.890944 (+ 82us) server_negotiation.cc:407] Connection header received
0810 01:37:35.891058 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:35.891060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:35.891107 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:35.891181 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:35.891905 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.892999 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.894081 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:35.894329 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:35.894443 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:35.897675 (+ 3232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:56123: BlockingRecv error: recv got EOF from 127.24.205.130:56123 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 01:37:36 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:36 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:36.095259 7269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:36.089732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:37843)
0810 01:37:36.090042 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:36.090058 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:36.090175 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:36.090447 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:36.090449 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:36.090635 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:36.090750 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:36.090755 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.091490 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.091493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:36.092053 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:36.092090 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.092502 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.092504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:36.092567 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:36.093157 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:36.093171 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:36.095085 (+ 1914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":123,"threads_started":1}
W20260810 01:37:36.095362 7267 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:36.089812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:37843 (local address 127.24.205.190:44541)
0810 01:37:36.089950 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:36.089954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:36.090143 (+ 189us) server_negotiation.cc:407] Connection header received
0810 01:37:36.090280 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:36.090283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:36.090331 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:36.090406 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:36.090851 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.091391 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.092178 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.092404 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.092481 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:36.095236 (+ 2755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:37843: BlockingRecv error: recv got EOF from 127.24.205.131:37843 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 01:37:36 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:36 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:36.718889 7271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:36.713197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:60721)
0810 01:37:36.713468 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:36.713482 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:36.713572 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:36.713829 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:36.713831 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:36.714009 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:36.714112 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:36.714118 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.714846 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.714848 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:36.715437 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:36.715446 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.716039 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.716042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:36.716180 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:36.716799 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:36.716815 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:36.718774 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":93,"threads_started":1}
W20260810 01:37:36.719096 7272 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:36.713268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:60721 (local address 127.24.205.190:44541)
0810 01:37:36.713536 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:36.713540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:36.713555 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:36.713665 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:36.713668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:36.713712 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:36.713795 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:36.714221 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.714751 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.715569 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.715903 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.716017 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:36.718919 (+ 2902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:60721: BlockingRecv error: recv got EOF from 127.24.205.129:60721 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":106,"threads_started":1}
Aug 10 01:37:36 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:36 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:36.904958 7273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:36.898509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:44941)
0810 01:37:36.898769 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:36.898785 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:36.898948 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:36.899232 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:36.899238 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:36.899471 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:36.899603 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:36.899611 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.900740 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.900742 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:36.901303 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:36.901311 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.901788 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.901790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:36.901852 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:36.902425 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:36.902443 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:36.904846 (+ 2403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
W20260810 01:37:36.905229 7272 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:36.898578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:44941 (local address 127.24.205.190:44541)
0810 01:37:36.898754 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:36.898759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:36.898875 (+ 116us) server_negotiation.cc:407] Connection header received
0810 01:37:36.899058 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:36.899060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:36.899109 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:36.899187 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:36.899762 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.900628 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.901417 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:36.901640 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:36.901791 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:36.904983 (+ 3192us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:44941: BlockingRecv error: recv got EOF from 127.24.205.130:44941 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 01:37:37 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:37 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:37.101495 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:37.096105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:53121)
0810 01:37:37.096422 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:37.096444 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:37.096545 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:37.096785 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:37.096787 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:37.096974 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:37.097094 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:37.097128 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.097920 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.097922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:37.098485 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:37.098492 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.098903 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.098906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:37.098966 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:37.099451 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:37.099462 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:37.101380 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":107,"threads_started":1}
W20260810 01:37:37.101706 7272 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:37.096278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:53121 (local address 127.24.205.190:44541)
0810 01:37:37.096413 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:37.096417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:37.096515 (+ 98us) server_negotiation.cc:407] Connection header received
0810 01:37:37.096625 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:37.096627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:37.096677 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:37.096751 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:37.097267 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.097822 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.098587 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.098804 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.098880 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:37.101581 (+ 2701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:53121: BlockingRecv error: recv got EOF from 127.24.205.131:53121 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 01:37:37 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:37 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:37.725186 7275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:37.719648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:38631)
0810 01:37:37.719928 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:37.719942 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:37.720026 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:37.720368 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:37.720370 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:37.720575 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:37.720678 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:37.720683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.721439 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.721441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:37.722009 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:37.722017 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.722473 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.722475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:37.722538 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:37.723081 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:37.723094 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:37.725065 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":100,"threads_started":1}
W20260810 01:37:37.725363 7276 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:37.719740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:38631 (local address 127.24.205.190:44541)
0810 01:37:37.719974 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:37.719977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:37.719990 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:37:37.720195 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:37.720198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:37.720243 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:37.720321 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:37.720799 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.721342 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.722125 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.722368 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.722450 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:37.725222 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:38631: BlockingRecv error: recv got EOF from 127.24.205.129:38631 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":86,"threads_started":1}
Aug 10 01:37:37 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:37 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:37.911418 7277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:37.905768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:51301)
0810 01:37:37.906097 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:37.906112 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:37.906209 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:37.906438 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:37.906440 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:37.906626 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:37.906734 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:37.906740 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.907481 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.907483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:37.908122 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:37.908133 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.908593 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.908595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:37.908664 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:37.909150 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:37.909171 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:37.911271 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":131,"threads_started":1}
W20260810 01:37:37.911517 7276 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:37.905819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:51301 (local address 127.24.205.190:44541)
0810 01:37:37.905975 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:37.905980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:37.906186 (+ 206us) server_negotiation.cc:407] Connection header received
0810 01:37:37.906285 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:37.906288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:37.906334 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:37.906403 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:37.906835 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.907376 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.908249 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:37.908482 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:37.908574 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:37.911422 (+ 2848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:51301: BlockingRecv error: recv got EOF from 127.24.205.130:51301 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 01:37:38 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:38 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:38.107568 7278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:38.102318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:57921)
0810 01:37:38.102638 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:38.102663 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:38.102754 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:38.102971 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:38.102973 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:38.103161 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:38.103260 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:38.103265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.104140 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.104142 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:38.104697 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:38.104704 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.105118 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.105121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:38.105185 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:38.105686 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:38.105697 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:38.107454 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":127,"threads_started":1}
W20260810 01:37:38.107718 7276 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:38.102466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:57921 (local address 127.24.205.190:44541)
0810 01:37:38.102618 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:38.102625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:38.102740 (+ 115us) server_negotiation.cc:407] Connection header received
0810 01:37:38.102829 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:38.102831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:38.102877 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:38.102950 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:38.103366 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.103988 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.104803 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.105020 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.105100 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:38.107590 (+ 2490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:57921: BlockingRecv error: recv got EOF from 127.24.205.131:57921 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 01:37:38 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:38 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:38.737118 7280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:38.726146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:33441)
0810 01:37:38.726458 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:38.726474 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:38.726617 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:38.726903 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:38.726906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:38.727122 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:38.727228 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:38.727234 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.728030 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.728035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:38.729081 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:38.729096 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.729862 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.729868 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:38.729987 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:38.734270 (+ 4283us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:38.734290 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:38.736863 (+ 2573us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":103,"threads_started":1}
W20260810 01:37:38.737663 7281 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:38.726203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:33441 (local address 127.24.205.190:44541)
0810 01:37:38.726486 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:38.726493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:38.726553 (+ 60us) server_negotiation.cc:407] Connection header received
0810 01:37:38.726726 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:38.726730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:38.726785 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:38.726882 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:38.727353 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.727916 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.729246 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.729699 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.729842 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:38.737475 (+ 7633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:33441: BlockingRecv error: recv got EOF from 127.24.205.129:33441 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":110,"threads_started":1}
Aug 10 01:37:38 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:38 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:38.918597 7285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:38.912400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:34603)
0810 01:37:38.912704 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:38.912725 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:38.912888 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:38.913195 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:38.913198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:38.913411 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:38.913510 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:38.913516 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.914306 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.914310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:38.915372 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:38.915382 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.915894 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.915898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:38.915986 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:38.916556 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:38.916568 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:38.918474 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":123,"threads_started":1}
W20260810 01:37:38.918737 7281 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:38.912456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:34603 (local address 127.24.205.190:44541)
0810 01:37:38.912607 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:38.912612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:38.912804 (+ 192us) server_negotiation.cc:407] Connection header received
0810 01:37:38.913014 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:38.913017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:38.913074 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:38.913162 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:38.913633 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.914178 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.915529 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:38.915765 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:38.915878 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:38.918616 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:34603: BlockingRecv error: recv got EOF from 127.24.205.130:34603 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 01:37:39 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:39 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:39.113871 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:39.108381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:58533)
0810 01:37:39.108679 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:39.108692 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:39.108791 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:39.109008 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:39.109009 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:39.109204 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:39.109300 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:39.109305 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.110027 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.110030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:39.110586 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:39.110593 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.111010 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.111012 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:39.111074 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:39.111576 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:39.111587 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:39.113690 (+ 2103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":118,"threads_started":1}
W20260810 01:37:39.113932 7281 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:39.108431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:58533 (local address 127.24.205.190:44541)
0810 01:37:39.108576 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:39.108579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:39.108762 (+ 183us) server_negotiation.cc:407] Connection header received
0810 01:37:39.108875 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:39.108877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:39.108926 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:39.108995 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:39.109399 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.109928 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.110690 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.110910 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.110986 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:39.113823 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:58533: BlockingRecv error: recv got EOF from 127.24.205.131:58533 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 01:37:39 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:39 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:39.744037 7288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:39.738655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:47173)
0810 01:37:39.738959 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:39.738973 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:39.739093 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:39.739339 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:39.739342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:39.739527 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:39.739632 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:39.739637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.740459 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.740462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:39.741022 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:39.741030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.741462 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.741464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:39.741526 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:39.742065 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:39.742092 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:39.743922 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":125,"threads_started":1}
W20260810 01:37:39.744230 7289 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:39.738689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:47173 (local address 127.24.205.190:44541)
0810 01:37:39.738950 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:39.738953 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:39.739023 (+ 70us) server_negotiation.cc:407] Connection header received
0810 01:37:39.739173 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:39.739176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:39.739218 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:39.739297 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:39.739768 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.740352 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.741133 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.741367 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.741443 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:39.744083 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:47173: BlockingRecv error: recv got EOF from 127.24.205.129:47173 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":93,"threads_started":1}
Aug 10 01:37:39 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:39 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:39.925092 7290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:39.919385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:54719)
0810 01:37:39.919681 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:39.919695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:39.919797 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:39.920026 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:39.920028 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:39.920267 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:39.920375 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:39.920380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.921115 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.921117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:39.921677 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:39.921684 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.922100 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.922103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:39.922177 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:39.922733 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:39.922745 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:39.924978 (+ 2233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":109,"threads_started":1}
W20260810 01:37:39.925329 7289 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:39.919473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:54719 (local address 127.24.205.190:44541)
0810 01:37:39.919633 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:39.919645 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:39.919765 (+ 120us) server_negotiation.cc:407] Connection header received
0810 01:37:39.919871 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:39.919873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:39.919917 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:39.919991 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:39.920478 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.921020 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.921775 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:39.921996 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:39.922073 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:39.925180 (+ 3107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:54719: BlockingRecv error: recv got EOF from 127.24.205.130:54719 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 10 01:37:40 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:40 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:40.120177 7291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:40.114746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:59891)
0810 01:37:40.115040 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:40.115054 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:40.115159 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:40.115399 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:40.115402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:40.115599 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:40.115703 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:40.115709 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.116472 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.116475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:40.117035 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:40.117043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.117457 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.117460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:40.117521 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:40.118041 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:40.118053 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:40.119981 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":115,"threads_started":1}
W20260810 01:37:40.120311 7289 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:40.114810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:59891 (local address 127.24.205.190:44541)
0810 01:37:40.114957 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:40.114960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:40.115130 (+ 170us) server_negotiation.cc:407] Connection header received
0810 01:37:40.115245 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:40.115247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:40.115296 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:40.115358 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:40.115809 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.116375 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.117139 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.117361 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.117439 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:40.120189 (+ 2750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:59891: BlockingRecv error: recv got EOF from 127.24.205.131:59891 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 01:37:40 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:40 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:40.750389 7292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:40.744959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:58657)
0810 01:37:40.745272 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:40.745287 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:40.745393 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:40.745652 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:40.745654 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:40.745846 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:40.745956 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:40.745962 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.746712 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.746714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:40.747275 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:40.747284 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.747703 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.747706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:40.747768 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:40.748311 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:40.748323 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:40.750200 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":98,"threads_started":1}
W20260810 01:37:40.750473 7295 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:40.745020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:58657 (local address 127.24.205.190:44541)
0810 01:37:40.745283 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:40.745287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:40.745339 (+ 52us) server_negotiation.cc:407] Connection header received
0810 01:37:40.745479 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:40.745482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:40.745529 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:40.745611 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:40.746063 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.746612 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.747379 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.747602 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.747680 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:40.750335 (+ 2655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:58657: BlockingRecv error: recv got EOF from 127.24.205.129:58657 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":95,"threads_started":1}
Aug 10 01:37:40 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:40 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:40.931524 7297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:40.925914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:51729)
0810 01:37:40.926209 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:40.926227 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:40.926357 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:40.926660 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:40.926663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:40.926912 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:40.927046 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:40.927054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.927816 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.927818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:40.928444 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:40.928453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.928910 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.928913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:40.928982 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:40.929587 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:40.929600 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:40.931410 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":86,"threads_started":1}
W20260810 01:37:40.931699 7295 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:40.926046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:51729 (local address 127.24.205.190:44541)
0810 01:37:40.926223 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:40.926227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:40.926288 (+ 61us) server_negotiation.cc:407] Connection header received
0810 01:37:40.926458 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:40.926461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:40.926520 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:40.926590 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:40.927180 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.927719 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.928552 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:40.928779 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:40.928856 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:40.931539 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:51729: BlockingRecv error: recv got EOF from 127.24.205.130:51729 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 01:37:41 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:41 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:41.126950 7298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:41.120966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:37907)
0810 01:37:41.121266 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:41.121278 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:41.121408 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:41.121708 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:41.121711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:41.121937 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:41.122036 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:41.122042 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.122840 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.122845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:41.123419 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:41.123427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.123919 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.123922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:41.124005 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:41.124654 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:41.124673 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:41.126820 (+ 2147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":86,"threads_started":1}
W20260810 01:37:41.127229 7295 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:41.121024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:37907 (local address 127.24.205.190:44541)
0810 01:37:41.121201 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:41.121205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:41.121358 (+ 153us) server_negotiation.cc:407] Connection header received
0810 01:37:41.121526 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:41.121530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:41.121587 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:41.121677 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:41.122163 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.122723 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.123561 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.123794 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.123905 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:41.126959 (+ 3054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:37907: BlockingRecv error: recv got EOF from 127.24.205.131:37907 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 10 01:37:41 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:41 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:41.757270 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:41.751277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:50737)
0810 01:37:41.751559 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:41.751573 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:41.751669 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:41.751940 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:41.751943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:41.752202 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:41.752307 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:41.752314 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.753419 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.753423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:41.754039 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:41.754049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.754510 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.754513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:41.754587 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:41.755154 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:41.755166 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:41.757129 (+ 1963us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":108,"threads_started":1}
W20260810 01:37:41.757440 7304 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:41.751373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:50737 (local address 127.24.205.190:44541)
0810 01:37:41.751665 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:41.751669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:41.751683 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:37:41.751759 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:41.751762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:41.751805 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:41.751885 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:41.752442 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.753279 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.754152 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.754378 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.754460 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:41.757268 (+ 2808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:50737: BlockingRecv error: recv got EOF from 127.24.205.129:50737 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":88,"threads_started":1}
Aug 10 01:37:41 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:41 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:41.938287 7307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:41.932391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:36061)
0810 01:37:41.932695 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:41.932710 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:41.932819 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:41.933092 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:41.933094 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:41.933298 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:41.933401 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:41.933407 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.934203 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.934206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:41.934793 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:41.934802 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.935291 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.935294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:41.935358 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:41.935870 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:41.935882 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:41.938131 (+ 2249us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":120,"threads_started":1}
W20260810 01:37:41.938491 7304 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:41.932474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:36061 (local address 127.24.205.190:44541)
0810 01:37:41.932638 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:41.932642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:41.932785 (+ 143us) server_negotiation.cc:407] Connection header received
0810 01:37:41.932891 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:41.932893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:41.932941 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:41.933051 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:41.933514 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.934077 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.934918 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:41.935180 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:41.935273 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:41.938341 (+ 3068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:36061: BlockingRecv error: recv got EOF from 127.24.205.130:36061 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 01:37:42 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:42 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.131@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:42.133564 7308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:42.127786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.131:46809)
0810 01:37:42.128177 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:42.128190 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:42.128329 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:42.128626 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:42.128629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:42.128854 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:42.128952 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:42.128957 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.129778 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.129783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:42.130367 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:42.130376 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.130859 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.130863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:42.130951 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:42.131492 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:42.131503 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:42.133392 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":105,"threads_started":1}
W20260810 01:37:42.133663 7304 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:42.127832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:46809 (local address 127.24.205.190:44541)
0810 01:37:42.127968 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:42.127974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:42.128268 (+ 294us) server_negotiation.cc:407] Connection header received
0810 01:37:42.128441 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:42.128444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:42.128503 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:42.128599 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:42.129099 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.129661 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.130494 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.130738 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.130854 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:42.133538 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.131:46809: BlockingRecv error: recv got EOF from 127.24.205.131:46809 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 10 01:37:42 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:42 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.129@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:42.764460 7309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:42.758227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.129:38453)
0810 01:37:42.758537 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:42.758553 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:42.758646 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:42.758922 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:42.758924 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:42.759134 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:42.759238 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:42.759244 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.760056 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.760107 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:42.760720 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:42.760730 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.761331 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.761335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:42.761426 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:42.762175 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:42.762197 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:42.764343 (+ 2146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":75,"threads_started":1}
W20260810 01:37:42.764694 7310 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:42.758355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:38453 (local address 127.24.205.190:44541)
0810 01:37:42.758627 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:42.758630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:42.758645 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:37:42.758717 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:42.758719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:42.758763 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:42.758844 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:42.759360 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.759928 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.760833 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.761197 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.761326 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:42.764518 (+ 3192us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.129:38453: BlockingRecv error: recv got EOF from 127.24.205.129:38453 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":88,"threads_started":1}
Aug 10 01:37:42 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:37:42 dist-test-slave-t3q3 krb5kdc[5638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.205.130@KRBTEST.COM for oryx/127.24.205.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:37:42.945763 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:42.939317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:44541 (local address 127.24.205.130:35203)
0810 01:37:42.939673 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:42.939687 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:42.939829 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:42.940135 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:42.940138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:42.940368 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:42.940469 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:42.940475 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.941284 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.941288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:42.942004 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:42.942017 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.942557 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.942560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:42.942646 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:42.943243 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:42.943266 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:42.945629 (+ 2363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.205.190:44541: Server oryx/127.24.205.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":115,"threads_started":1}
W20260810 01:37:42.946003 7310 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:42.939450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:35203 (local address 127.24.205.190:44541)
0810 01:37:42.939619 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:42.939624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:42.939768 (+ 144us) server_negotiation.cc:407] Connection header received
0810 01:37:42.939952 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:42.939955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:42.940003 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:42.940120 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:42.940600 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.941161 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.942160 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:42.942417 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:42.942536 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:42.945869 (+ 3333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.205.130:35203: BlockingRecv error: recv got EOF from 127.24.205.130:35203 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:37:43.025079 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 6560
I20260810 01:37:43.037563 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 6799
I20260810 01:37:43.049463 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 7003
I20260810 01:37:43.062347 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 6437
2026-08-10T01:37:43Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18359 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T01:37:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:43Z Disabled control of system clock
I20260810 01:37:43.101079 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:40315
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:37761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:40315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 01:37:43.216203 7319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:43.216500 7319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:43.216543 7319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:43.220606 7319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:43.220669 7319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:43.220683 7319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:43.220700 7319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:43.220749 7319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:43.225545 7319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:40315
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:40315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:43.226789 7319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:43.228262 7319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:43.236956 7327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:43.237048 7328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:43.237005 7331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:43.237028 7319 server_base.cc:1034] running on GCE node
I20260810 01:37:43.237797 7319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:43.238862 7319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:43.240096 7319 hybrid_clock.cc:648] HybridClock initialized: now 1786325863240042 us; error 31 us; skew 500 ppm
I20260810 01:37:43.241971 7319 webserver.cc:460] Webserver started at http://127.24.205.190:33407/ using document root <none> and password file <none>
I20260810 01:37:43.242568 7319 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:43.242677 7319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:43.242918 7319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:43.245044 7319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "bd5215c693bd41809125032940558750"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "fd479e83959eb563616a712868e7984e"
server_key_iv: "24fc3e4f28379c97374f7c740940c0d1"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.245630 7319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "bd5215c693bd41809125032940558750"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "fd479e83959eb563616a712868e7984e"
server_key_iv: "24fc3e4f28379c97374f7c740940c0d1"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.249339 7319 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:43.251784 7346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.253129 7319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:43.253273 7319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "bd5215c693bd41809125032940558750"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "fd479e83959eb563616a712868e7984e"
server_key_iv: "24fc3e4f28379c97374f7c740940c0d1"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.253393 7319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:43.284772 7319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:43.285573 7319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:43.285806 7319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:43.293427 7319 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:40315
I20260810 01:37:43.293449 7428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:40315 every 8 connection(s)
I20260810 01:37:43.294422 7319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:43.297791 7429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:43.297854 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 7319
I20260810 01:37:43.297963 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:43.298346 25398 external_mini_cluster.cc:1428] Setting key d76db4a9bfb49f494b405b0242cdb264
I20260810 01:37:43.304574 7429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750: Bootstrap starting.
I20260810 01:37:43.306774 7429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:43.307641 7429 log.cc:824] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:43.307910 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:43.299861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49376 (local address 127.24.205.190:40315)
0810 01:37:43.300570 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:43.300589 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:43.300625 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:37:43.301317 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:43.301335 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:43.301728 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:43.302073 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:43.302521 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.303569 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.304564 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.305091 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.305278 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:43.306194 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:43.306199 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:43.306212 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:43.306588 (+ 376us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:43.306648 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:43.306670 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:43.306787 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:43.306905 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 01:37:43.307166 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":364,"thread_start_us":174,"threads_started":1}
I20260810 01:37:43.309808 7429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750: No bootstrap required, opened a new log
I20260810 01:37:43.313388 7429 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5215c693bd41809125032940558750" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40315 } }
I20260810 01:37:43.313690 7429 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:43.313767 7429 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd5215c693bd41809125032940558750, State: Initialized, Role: FOLLOWER
I20260810 01:37:43.314241 7429 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5215c693bd41809125032940558750" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40315 } }
I20260810 01:37:43.314396 7429 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:43.314460 7429 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:43.314568 7429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:43.315416 7429 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5215c693bd41809125032940558750" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40315 } }
I20260810 01:37:43.315758 7429 leader_election.cc:302] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd5215c693bd41809125032940558750; no voters:
I20260810 01:37:43.316098 7429 leader_election.cc:288] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:43.316205 7436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:43.316491 7436 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [term 1 LEADER]: Becoming Leader. State: Replica: bd5215c693bd41809125032940558750, State: Running, Role: LEADER
I20260810 01:37:43.316829 7436 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5215c693bd41809125032940558750" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40315 } }
I20260810 01:37:43.317296 7429 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:43.318323 7438 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd5215c693bd41809125032940558750. Latest consensus state: current_term: 1 leader_uuid: "bd5215c693bd41809125032940558750" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5215c693bd41809125032940558750" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40315 } } }
I20260810 01:37:43.318477 7438 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:43.318886 7446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:43.318847 7437 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd5215c693bd41809125032940558750" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5215c693bd41809125032940558750" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40315 } } }
I20260810 01:37:43.318934 7437 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:43.321861 7446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:43.327077 7446 catalog_manager.cc:1347] Generated new cluster ID: afa64f689f5848cab4d6785ba3e42f51
I20260810 01:37:43.327142 7446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:43.337589 7446 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:43.338694 7446 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:43.353891 7446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd5215c693bd41809125032940558750: Generated new TSK 0
I20260810 01:37:43.354655 7446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:37:43.359557 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40315
--builtin_ntp_servers=127.24.205.148:37761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 01:37:43.472955 7463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:43.473274 7463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:43.473346 7463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:43.477406 7463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:43.477500 7463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:43.477599 7463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:43.482376 7463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:43.483445 7463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:43.484861 7463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:43.494648 7472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:43.494709 7477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:43.494709 7473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:43.495085 7463 server_base.cc:1034] running on GCE node
I20260810 01:37:43.495513 7463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:43.496186 7463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:43.497404 7463 hybrid_clock.cc:648] HybridClock initialized: now 1786325863497393 us; error 34 us; skew 500 ppm
I20260810 01:37:43.499159 7463 webserver.cc:460] Webserver started at http://127.24.205.129:38835/ using document root <none> and password file <none>
I20260810 01:37:43.499696 7463 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:43.499755 7463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:43.499918 7463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:43.502076 7463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "b2e3acb036674befa07aae2fb5c2c60d"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "40e4f1d0a8bc2300edd1aff19dbce1a7"
server_key_iv: "f691b9d45467a984d9b66df676dc0b5f"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.502593 7463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "b2e3acb036674befa07aae2fb5c2c60d"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "40e4f1d0a8bc2300edd1aff19dbce1a7"
server_key_iv: "f691b9d45467a984d9b66df676dc0b5f"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.506740 7463 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:37:43.509497 7489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.510692 7463 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:43.510846 7463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "b2e3acb036674befa07aae2fb5c2c60d"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "40e4f1d0a8bc2300edd1aff19dbce1a7"
server_key_iv: "f691b9d45467a984d9b66df676dc0b5f"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.510977 7463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:43.527576 7463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:43.528286 7463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:43.528475 7463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:43.529057 7463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:43.529996 7463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:43.530078 7463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.530146 7463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:43.530198 7463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.539438 7463 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:34067
I20260810 01:37:43.539463 7676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:34067 every 8 connection(s)
I20260810 01:37:43.540397 7463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:43.547322 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 7463
I20260810 01:37:43.547451 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:43.547794 25398 external_mini_cluster.cc:1428] Setting key 6acedbfa8296092ac7fb85dbb796cb8d
I20260810 01:37:43.550113 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40315
--builtin_ntp_servers=127.24.205.148:37761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 01:37:43.550659 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:43.542344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:39125 (local address 127.24.205.190:40315)
0810 01:37:43.542495 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:43.542500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:43.543652 (+ 1152us) server_negotiation.cc:407] Connection header received
0810 01:37:43.545079 (+ 1427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:43.545083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:43.545131 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:43.545211 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:43.546150 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.546714 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.548396 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.548737 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.548854 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:43.550092 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:43.550095 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:43.550098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:43.550109 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:43.550129 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:43.550137 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:43.550228 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:43.550472 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:37:43.550535 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:37:43.551906 7681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:43.542816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:40315 (local address 127.24.205.129:39125)
0810 01:37:43.543492 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:43.543538 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:43.544855 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:43.545387 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:43.545395 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:43.545481 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:43.545973 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:43.545984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.546824 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.546827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:43.548257 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:43.548267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.548888 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.548891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:43.549058 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:43.549768 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:43.549770 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:43.549830 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:43.549924 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:43.550239 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:43.550252 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:43.550262 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 01:37:43.550446 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 01:37:43.550776 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":121,"threads_started":1}
I20260810 01:37:43.553468 7677 heartbeater.cc:347] Connected to a master server at 127.24.205.190:40315
I20260810 01:37:43.553752 7677 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:43.554422 7677 heartbeater.cc:511] Master 127.24.205.190:40315 requested a full tablet report, sending...
I20260810 01:37:43.556234 7371 ts_manager.cc:194] Registered new tserver with Master: b2e3acb036674befa07aae2fb5c2c60d (127.24.205.129:34067)
I20260810 01:37:43.557597 7371 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.129:39125
W20260810 01:37:43.665019 7683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:43.665318 7683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:43.665388 7683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:43.669394 7683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:43.669467 7683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:43.669557 7683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:43.674178 7683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:43.675242 7683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:43.676710 7683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:43.686481 7690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:43.686673 7683 server_base.cc:1034] running on GCE node
W20260810 01:37:43.686559 7692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:43.686542 7689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:43.687247 7683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:43.687876 7683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:43.689061 7683 hybrid_clock.cc:648] HybridClock initialized: now 1786325863689048 us; error 63 us; skew 500 ppm
I20260810 01:37:43.691107 7683 webserver.cc:460] Webserver started at http://127.24.205.130:34591/ using document root <none> and password file <none>
I20260810 01:37:43.691684 7683 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:43.691778 7683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:43.692014 7683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:43.694092 7683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "6581675fa4214acc96a1d0faaba6079a"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "e004f4a95c3bab3ba6ae1eb4614f1096"
server_key_iv: "e66eaf4ecbfe4402a5cd58d70b97a96d"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.694675 7683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "6581675fa4214acc96a1d0faaba6079a"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "e004f4a95c3bab3ba6ae1eb4614f1096"
server_key_iv: "e66eaf4ecbfe4402a5cd58d70b97a96d"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.698324 7683 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:37:43.700862 7702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.702090 7683 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:43.702242 7683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "6581675fa4214acc96a1d0faaba6079a"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "e004f4a95c3bab3ba6ae1eb4614f1096"
server_key_iv: "e66eaf4ecbfe4402a5cd58d70b97a96d"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.702355 7683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:43.730726 7683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:43.731518 7683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:43.731740 7683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:43.732461 7683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:43.733497 7683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:43.733573 7683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.733647 7683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:43.733700 7683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.743350 7683 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:33201
I20260810 01:37:43.743402 7883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:33201 every 8 connection(s)
I20260810 01:37:43.744395 7683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:43.748739 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 7683
I20260810 01:37:43.748868 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:43.749251 25398 external_mini_cluster.cc:1428] Setting key ca2ede83761181118c84349e4b653abc
I20260810 01:37:43.751446 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40315
--builtin_ntp_servers=127.24.205.148:37761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 01:37:43.759233 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:43.746294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:56809 (local address 127.24.205.190:40315)
0810 01:37:43.746442 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:43.746446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:43.747449 (+ 1003us) server_negotiation.cc:407] Connection header received
0810 01:37:43.749094 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:43.749097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:43.749147 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:43.749223 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:43.750329 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.751031 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.752826 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.753049 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.753132 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:43.758606 (+ 5474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:43.758613 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:43.758619 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:43.758636 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:43.758672 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:43.758687 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:43.758783 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:43.758941 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 01:37:43.759023 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:37:43.760021 7886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:43.746605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:40315 (local address 127.24.205.130:56809)
0810 01:37:43.747290 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:43.747332 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:43.748862 (+ 1530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:43.749411 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:43.749421 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:43.749541 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:43.750183 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:43.750199 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.751171 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.751177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:43.752699 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:43.752714 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.753214 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.753221 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:43.753452 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:43.758311 (+ 4859us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:43.758313 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:43.758357 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:43.758428 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:43.758781 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:43.758788 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:43.758793 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:37:43.758886 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 01:37:43.759130 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":103,"threads_started":1}
I20260810 01:37:43.761273 7884 heartbeater.cc:347] Connected to a master server at 127.24.205.190:40315
I20260810 01:37:43.761543 7884 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:43.762112 7884 heartbeater.cc:511] Master 127.24.205.190:40315 requested a full tablet report, sending...
I20260810 01:37:43.763190 7371 ts_manager.cc:194] Registered new tserver with Master: 6581675fa4214acc96a1d0faaba6079a (127.24.205.130:33201)
I20260810 01:37:43.763782 7371 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.130:56809
W20260810 01:37:43.868574 7887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:43.868871 7887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:43.868942 7887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:43.872964 7887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:43.873071 7887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:43.873167 7887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:43.877944 7887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:43.879184 7887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:43.880676 7887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:43.890760 7897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:43.890779 7898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:43.890767 7900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:43.891363 7887 server_base.cc:1034] running on GCE node
I20260810 01:37:43.891804 7887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:43.892553 7887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:43.893729 7887 hybrid_clock.cc:648] HybridClock initialized: now 1786325863893688 us; error 61 us; skew 500 ppm
I20260810 01:37:43.895769 7887 webserver.cc:460] Webserver started at http://127.24.205.131:37513/ using document root <none> and password file <none>
I20260810 01:37:43.896488 7887 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:43.896559 7887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:43.896831 7887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:43.899032 7887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "abc99891e1324ebdb42e87b973b0af39"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "f61663200c9adf14449c3306a34ddddb"
server_key_iv: "faf9311f57f98d1f9dd0374838e08d67"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.899662 7887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "abc99891e1324ebdb42e87b973b0af39"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "f61663200c9adf14449c3306a34ddddb"
server_key_iv: "faf9311f57f98d1f9dd0374838e08d67"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.903657 7887 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:37:43.906551 7908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.907892 7887 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:37:43.907992 7887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "abc99891e1324ebdb42e87b973b0af39"
format_stamp: "Formatted at 2026-08-10 01:37:43 on dist-test-slave-t3q3"
server_key: "f61663200c9adf14449c3306a34ddddb"
server_key_iv: "faf9311f57f98d1f9dd0374838e08d67"
server_key_version: "encryptionkey@0"
I20260810 01:37:43.908164 7887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:43.927968 7887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:43.928833 7887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:43.929054 7887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:43.929733 7887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:43.930781 7887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:43.930838 7887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.930882 7887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:43.930898 7887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:43.940469 7887 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:37609
I20260810 01:37:43.940490 8085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:37609 every 8 connection(s)
I20260810 01:37:43.941469 7887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:43.949890 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 7887
I20260810 01:37:43.950026 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:43.950450 25398 external_mini_cluster.cc:1428] Setting key dc3c490a26b0f53e6eb6192c8967f7f1
I20260810 01:37:43.951224 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:43.943436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:51521 (local address 127.24.205.190:40315)
0810 01:37:43.943632 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:43.943637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:43.944846 (+ 1209us) server_negotiation.cc:407] Connection header received
0810 01:37:43.946243 (+ 1397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:43.946246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:43.946295 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:43.946377 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:43.947361 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.947919 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.949118 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.949343 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.949444 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:43.950708 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:43.950712 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:43.950714 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:43.950727 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:43.950748 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:43.950756 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:43.950857 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:43.951017 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 01:37:43.951087 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 01:37:43.952343 8088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:43.943890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:40315 (local address 127.24.205.131:51521)
0810 01:37:43.944673 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:43.944718 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:43.946000 (+ 1282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:43.946563 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:43.946570 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:43.946656 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:43.947178 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:43.947191 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.948045 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.948047 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:43.948983 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:43.948993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:43.949494 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:43.949496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:43.949700 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:43.950404 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:43.950407 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:43.950462 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:43.950549 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:43.950868 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:43.950875 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:43.950880 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:37:43.950983 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 01:37:43.951325 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":200,"threads_started":1}
I20260810 01:37:43.953449 8086 heartbeater.cc:347] Connected to a master server at 127.24.205.190:40315
I20260810 01:37:43.953683 8086 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:43.954227 8086 heartbeater.cc:511] Master 127.24.205.190:40315 requested a full tablet report, sending...
I20260810 01:37:43.955250 7371 ts_manager.cc:194] Registered new tserver with Master: abc99891e1324ebdb42e87b973b0af39 (127.24.205.131:37609)
I20260810 01:37:43.955829 7371 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.131:51521
I20260810 01:37:43.964740 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 01:37:43.967650 7432 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:43.966619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49384 (local address 127.24.205.190:40315)
0810 01:37:43.966743 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:43.966746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:43.966986 (+ 240us) server_negotiation.cc:407] Connection header received
0810 01:37:43.967097 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:43.967099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:43.967140 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:43.967249 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:43.967527 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49384: BlockingRecv error: recv got EOF from 127.0.0.1:49384 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:37:43.967942 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 7463
I20260810 01:37:43.990773 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 7683
I20260810 01:37:44.006247 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 7887
I20260810 01:37:44.019626 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 7319
2026-08-10T01:37:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (957 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T01:37:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:44Z Disabled control of system clock
I20260810 01:37:44.059571 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41897
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 01:37:44.172541 8101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:44.172806 8101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:44.172842 8101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:44.176844 8101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:44.176896 8101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:44.176913 8101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:44.176929 8101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:44.176944 8101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:44.181731 8101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:44.182756 8101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:44.184101 8101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:44.192929 8117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:44.192948 8101 server_base.cc:1034] running on GCE node
W20260810 01:37:44.192898 8112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:44.192904 8115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:44.193719 8101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:44.194738 8101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:44.195901 8101 hybrid_clock.cc:648] HybridClock initialized: now 1786325864195853 us; error 61 us; skew 500 ppm
I20260810 01:37:44.197780 8101 webserver.cc:460] Webserver started at http://127.24.205.190:41403/ using document root <none> and password file <none>
I20260810 01:37:44.198305 8101 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:44.198366 8101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:44.198534 8101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:44.200584 8101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "1b287f9565614a28b1189a4af1f4e727"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "f4efd34c63283857598cec76347e5ab7"
server_key_iv: "a270c0ddd61f1f3771c2938a1f61fa80"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.201114 8101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "1b287f9565614a28b1189a4af1f4e727"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "f4efd34c63283857598cec76347e5ab7"
server_key_iv: "a270c0ddd61f1f3771c2938a1f61fa80"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.204720 8101 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:44.207218 8127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.208544 8101 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:44.208686 8101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "1b287f9565614a28b1189a4af1f4e727"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "f4efd34c63283857598cec76347e5ab7"
server_key_iv: "a270c0ddd61f1f3771c2938a1f61fa80"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.208799 8101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:44.213380 8101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:44.213980 8101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:44.214166 8101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:44.221410 8101 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:41897
I20260810 01:37:44.221415 8220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:41897 every 8 connection(s)
I20260810 01:37:44.222352 8101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:44.225636 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 8101
I20260810 01:37:44.225785 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:44.225920 8221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:44.226131 25398 external_mini_cluster.cc:1428] Setting key dec5f9664902127d73a6c65c1e54709d
I20260810 01:37:44.231980 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:44.227561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48388 (local address 127.24.205.190:41897)
0810 01:37:44.228314 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:44.228330 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:44.228366 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:37:44.229223 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:44.229244 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:44.229596 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:44.229945 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:44.230754 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:44.230759 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:44.230771 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:44.230781 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:44.230835 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:44.230851 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:44.231003 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:44.231076 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 01:37:44.231327 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":148,"threads_started":1}
I20260810 01:37:44.232841 8221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727: Bootstrap starting.
I20260810 01:37:44.235250 8221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:44.236045 8221 log.cc:824] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:44.238116 8221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727: No bootstrap required, opened a new log
I20260810 01:37:44.241603 8221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b287f9565614a28b1189a4af1f4e727" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41897 } }
I20260810 01:37:44.241918 8221 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:44.241962 8221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b287f9565614a28b1189a4af1f4e727, State: Initialized, Role: FOLLOWER
I20260810 01:37:44.242482 8221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b287f9565614a28b1189a4af1f4e727" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41897 } }
I20260810 01:37:44.242619 8221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:44.242709 8221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:44.242816 8221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:44.243755 8221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b287f9565614a28b1189a4af1f4e727" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41897 } }
I20260810 01:37:44.244184 8221 leader_election.cc:302] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b287f9565614a28b1189a4af1f4e727; no voters:
I20260810 01:37:44.244511 8221 leader_election.cc:288] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:44.244670 8226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:44.244932 8226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [term 1 LEADER]: Becoming Leader. State: Replica: 1b287f9565614a28b1189a4af1f4e727, State: Running, Role: LEADER
I20260810 01:37:44.245255 8226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b287f9565614a28b1189a4af1f4e727" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41897 } }
I20260810 01:37:44.245779 8221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:44.246495 8226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b287f9565614a28b1189a4af1f4e727. Latest consensus state: current_term: 1 leader_uuid: "1b287f9565614a28b1189a4af1f4e727" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b287f9565614a28b1189a4af1f4e727" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41897 } } }
I20260810 01:37:44.246624 8226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:44.247011 8228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b287f9565614a28b1189a4af1f4e727" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b287f9565614a28b1189a4af1f4e727" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41897 } } }
I20260810 01:37:44.247113 8228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727 [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:44.247136 8242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:44.250190 8242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:44.256086 8242 catalog_manager.cc:1347] Generated new cluster ID: 6e634ac80cc04d18ba28d4dc0c7a38cc
I20260810 01:37:44.256170 8242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:44.268885 8242 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:44.269245 8242 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:44.280632 8242 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b287f9565614a28b1189a4af1f4e727: Generated new TSK 0
I20260810 01:37:44.281507 8242 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:37:44.297216 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41897
--builtin_ntp_servers=127.24.205.148:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 01:37:44.416571 8257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:44.416843 8257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:44.416884 8257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:44.420941 8257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:44.421008 8257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:44.421067 8257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:44.425863 8257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:44.427021 8257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:44.428529 8257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:44.438802 8268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:44.438802 8264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:44.438833 8263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:44.439083 8257 server_base.cc:1034] running on GCE node
I20260810 01:37:44.439553 8257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:44.440310 8257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:44.441473 8257 hybrid_clock.cc:648] HybridClock initialized: now 1786325864441451 us; error 36 us; skew 500 ppm
I20260810 01:37:44.443346 8257 webserver.cc:460] Webserver started at http://127.24.205.129:34561/ using document root <none> and password file <none>
I20260810 01:37:44.443944 8257 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:44.444010 8257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:44.444305 8257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:44.446564 8257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "202e9ed9e3744d1aa37a994f3de0281c"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "b9316c586a629d98fa10032e64562615"
server_key_iv: "d1215fbadedb1b24e2d8205799b71abb"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.447256 8257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "202e9ed9e3744d1aa37a994f3de0281c"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "b9316c586a629d98fa10032e64562615"
server_key_iv: "d1215fbadedb1b24e2d8205799b71abb"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.451031 8257 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:37:44.453776 8278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.455152 8257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:37:44.455255 8257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "202e9ed9e3744d1aa37a994f3de0281c"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "b9316c586a629d98fa10032e64562615"
server_key_iv: "d1215fbadedb1b24e2d8205799b71abb"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.455407 8257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:44.460614 8257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:44.461274 8257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:44.461473 8257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:44.462052 8257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:44.463006 8257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:44.463054 8257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.463122 8257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:44.463162 8257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.472570 8257 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:37469
I20260810 01:37:44.472604 8460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:37469 every 8 connection(s)
I20260810 01:37:44.473634 8257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:44.475365 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 8257
I20260810 01:37:44.475512 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:44.475883 25398 external_mini_cluster.cc:1428] Setting key 931b46724048b7b2d03a29044e7c0c3f
I20260810 01:37:44.478080 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41897
--builtin_ntp_servers=127.24.205.148:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 01:37:44.480538 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:44.475672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:58137 (local address 127.24.205.190:41897)
0810 01:37:44.475852 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:44.475858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:44.477152 (+ 1294us) server_negotiation.cc:407] Connection header received
0810 01:37:44.478601 (+ 1449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:44.478604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:44.478646 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:44.478730 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:44.480034 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:44.480038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:44.480040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:44.480052 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:44.480115 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:44.480126 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:44.480219 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:44.480397 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 01:37:44.480436 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 01:37:44.481729 8471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:44.476228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41897 (local address 127.24.205.129:58137)
0810 01:37:44.476972 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:44.477015 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:44.478383 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:44.478900 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:44.478907 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:44.478998 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:44.479671 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:44.479676 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:44.479739 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:44.479849 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:44.480234 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:44.480243 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:44.480251 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 01:37:44.480441 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 01:37:44.480714 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":150,"threads_started":1}
I20260810 01:37:44.483018 8468 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41897
I20260810 01:37:44.483266 8468 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:44.483700 8468 heartbeater.cc:511] Master 127.24.205.190:41897 requested a full tablet report, sending...
I20260810 01:37:44.485339 8153 ts_manager.cc:194] Registered new tserver with Master: 202e9ed9e3744d1aa37a994f3de0281c (127.24.205.129:37469)
W20260810 01:37:44.595127 8473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:44.595384 8473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:44.595423 8473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:44.599491 8473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:44.599541 8473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:44.599642 8473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:44.604350 8473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:44.605404 8473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:44.606771 8473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:44.616779 8480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:44.616811 8484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:44.616881 8481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:44.617244 8473 server_base.cc:1034] running on GCE node
I20260810 01:37:44.617662 8473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:44.618288 8473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:44.619482 8473 hybrid_clock.cc:648] HybridClock initialized: now 1786325864619446 us; error 43 us; skew 500 ppm
I20260810 01:37:44.621448 8473 webserver.cc:460] Webserver started at http://127.24.205.130:38751/ using document root <none> and password file <none>
I20260810 01:37:44.622047 8473 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:44.622110 8473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:44.622375 8473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:44.624646 8473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "9d8fa6088e904a3fa08d983c33e06836"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "42fc6a4488c14af8515b40d908957558"
server_key_iv: "34799e55cef7fabd3ec4d064447c56b2"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.625236 8473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "9d8fa6088e904a3fa08d983c33e06836"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "42fc6a4488c14af8515b40d908957558"
server_key_iv: "34799e55cef7fabd3ec4d064447c56b2"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.629281 8473 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:37:44.634033 8493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.635350 8473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:37:44.635496 8473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "9d8fa6088e904a3fa08d983c33e06836"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "42fc6a4488c14af8515b40d908957558"
server_key_iv: "34799e55cef7fabd3ec4d064447c56b2"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.635624 8473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:44.640378 8473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:44.641004 8473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:44.641202 8473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:44.641752 8473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:44.642704 8473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:44.642776 8473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.642846 8473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:44.642900 8473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.652395 8473 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:43609
I20260810 01:37:44.652422 8697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:43609 every 8 connection(s)
I20260810 01:37:44.653332 8473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:44.656883 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 8473
I20260810 01:37:44.657008 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:44.657332 25398 external_mini_cluster.cc:1428] Setting key 68d6406ea2eb60d27b716af322bf5f72
I20260810 01:37:44.659480 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41897
--builtin_ntp_servers=127.24.205.148:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 01:37:44.659704 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:44.655126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:54903 (local address 127.24.205.190:41897)
0810 01:37:44.655269 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:44.655273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:44.656454 (+ 1181us) server_negotiation.cc:407] Connection header received
0810 01:37:44.657884 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:44.657891 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:44.657940 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:44.658009 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:44.659212 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:44.659215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:44.659218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:44.659237 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:44.659257 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:44.659265 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:44.659358 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:44.659512 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 01:37:44.659576 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:37:44.660667 8701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:44.655528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41897 (local address 127.24.205.130:54903)
0810 01:37:44.656309 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:44.656351 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:44.657670 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:44.658205 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:44.658212 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:44.658300 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:44.658923 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:44.658925 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:44.658967 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:44.659046 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:44.659356 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:44.659366 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:44.659376 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 01:37:44.659559 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 01:37:44.659797 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":110,"threads_started":1}
I20260810 01:37:44.662014 8699 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41897
I20260810 01:37:44.662266 8699 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:44.662675 8699 heartbeater.cc:511] Master 127.24.205.190:41897 requested a full tablet report, sending...
I20260810 01:37:44.663769 8153 ts_manager.cc:194] Registered new tserver with Master: 9d8fa6088e904a3fa08d983c33e06836 (127.24.205.130:43609)
W20260810 01:37:44.778368 8702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:44.778637 8702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:44.778676 8702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:44.782871 8702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:44.782938 8702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:44.783028 8702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:44.788012 8702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:44.789229 8702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:44.790727 8702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:44.800546 8711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:44.800669 8702 server_base.cc:1034] running on GCE node
W20260810 01:37:44.800554 8720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:44.800546 8715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:44.801345 8702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:44.801940 8702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:44.803133 8702 hybrid_clock.cc:648] HybridClock initialized: now 1786325864803115 us; error 29 us; skew 500 ppm
I20260810 01:37:44.805169 8702 webserver.cc:460] Webserver started at http://127.24.205.131:43651/ using document root <none> and password file <none>
I20260810 01:37:44.805778 8702 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:44.805846 8702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:44.806069 8702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:44.808405 8702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "f4cbe409993243818589085966a18f41"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "dba18748a0878a8796e8822950a3168f"
server_key_iv: "e8514d2b5ff5a242da335bbef32dc88b"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.809003 8702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "f4cbe409993243818589085966a18f41"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "dba18748a0878a8796e8822950a3168f"
server_key_iv: "e8514d2b5ff5a242da335bbef32dc88b"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.813149 8702 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s
I20260810 01:37:44.815840 8736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.817126 8702 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:37:44.817253 8702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "f4cbe409993243818589085966a18f41"
format_stamp: "Formatted at 2026-08-10 01:37:44 on dist-test-slave-t3q3"
server_key: "dba18748a0878a8796e8822950a3168f"
server_key_iv: "e8514d2b5ff5a242da335bbef32dc88b"
server_key_version: "encryptionkey@0"
I20260810 01:37:44.817395 8702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:44.821928 8702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:44.822469 8702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:44.822605 8702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:44.823093 8702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:44.823966 8702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:44.824013 8702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.824052 8702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:44.824136 8702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:44.833120 8702 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:43237
I20260810 01:37:44.833144 8928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:43237 every 8 connection(s)
I20260810 01:37:44.834060 8702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:44.837903 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 8702
I20260810 01:37:44.838063 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:44.838402 25398 external_mini_cluster.cc:1428] Setting key f18bad628aada0adbcc2a8037a893ca5
I20260810 01:37:44.840942 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:44.835917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:46149 (local address 127.24.205.190:41897)
0810 01:37:44.836132 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:44.836138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:44.837237 (+ 1099us) server_negotiation.cc:407] Connection header received
0810 01:37:44.838744 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:44.838749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:44.838822 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:44.838923 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:44.840430 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:44.840433 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:44.840437 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:37:44.840450 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:44.840477 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:37:44.840487 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:44.840584 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:44.840782 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 01:37:44.840832 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 01:37:44.841930 8935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:44.836422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41897 (local address 127.24.205.131:46149)
0810 01:37:44.837084 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:44.837125 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:44.838490 (+ 1365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:44.839296 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:44.839307 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:44.839427 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:44.840155 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:37:44.840162 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:44.840204 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:37:44.840276 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:44.840596 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:44.840607 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:44.840616 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 01:37:44.840824 (+ 208us) client_negotiation.cc:240] Negotiation successful
0810 01:37:44.841122 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":107,"threads_started":1}
I20260810 01:37:44.843043 8929 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41897
I20260810 01:37:44.843274 8929 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:44.843703 8929 heartbeater.cc:511] Master 127.24.205.190:41897 requested a full tablet report, sending...
I20260810 01:37:44.844803 8153 ts_manager.cc:194] Registered new tserver with Master: f4cbe409993243818589085966a18f41 (127.24.205.131:43237)
I20260810 01:37:44.852721 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 01:37:44.855800 8224 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:37:44.854760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48398 (local address 127.24.205.190:41897)
0810 01:37:44.854928 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:44.854932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:44.855102 (+ 170us) server_negotiation.cc:407] Connection header received
0810 01:37:44.855262 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:44.855265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:44.855309 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:44.855396 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:44.855662 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48398: BlockingRecv error: recv got EOF from 127.0.0.1:48398 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 01:37:44.856112 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 8257
I20260810 01:37:44.870148 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 8473
I20260810 01:37:44.885715 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 8702
I20260810 01:37:44.901854 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 8101
2026-08-10T01:37:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (880 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:44 dist-test-slave-t3q3 krb5kdc[8947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:44 dist-test-slave-t3q3 krb5kdc[8947](info): set up 2 sockets
Aug 10 01:37:44 dist-test-slave-t3q3 krb5kdc[8947](info): commencing operation
krb5kdc: starting...
W20260810 01:37:46.211405 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:46 dist-test-slave-t3q3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:37:46.342931 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37143
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:37143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:46.457760 8970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:46.458056 8970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:46.458101 8970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:46.462054 8970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:37:46.462106 8970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:46.462126 8970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:46.462142 8970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:37:46.462158 8970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:37:46.467329 8970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:37143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:46.468361 8970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:46.469336 8970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:46.477955 8977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:46.477955 8980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:46.478111 8975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:46.478154 8970 server_base.cc:1034] running on GCE node
I20260810 01:37:46.478901 8970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:46.479977 8970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:46.481204 8970 hybrid_clock.cc:648] HybridClock initialized: now 1786325866481171 us; error 45 us; skew 500 ppm
Aug 10 01:37:46 dist-test-slave-t3q3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325866, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:46.484131 8970 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:37:46.485095 8970 webserver.cc:460] Webserver started at http://127.24.205.190:40895/ using document root <none> and password file <none>
I20260810 01:37:46.485666 8970 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:46.485761 8970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:46.485999 8970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:46.488010 8970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "c715b82aa1874a9e985a889b9ff00e6a"
format_stamp: "Formatted at 2026-08-10 01:37:46 on dist-test-slave-t3q3"
server_key: "606b7f7a99521c1962d6c9918d89f0a2"
server_key_iv: "c276133317565606b619ec4fd5b64e8e"
server_key_version: "encryptionkey@0"
I20260810 01:37:46.488656 8970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "c715b82aa1874a9e985a889b9ff00e6a"
format_stamp: "Formatted at 2026-08-10 01:37:46 on dist-test-slave-t3q3"
server_key: "606b7f7a99521c1962d6c9918d89f0a2"
server_key_iv: "c276133317565606b619ec4fd5b64e8e"
server_key_version: "encryptionkey@0"
I20260810 01:37:46.492429 8970 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:37:46.494742 8994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:46.495924 8970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:46.496134 8970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "c715b82aa1874a9e985a889b9ff00e6a"
format_stamp: "Formatted at 2026-08-10 01:37:46 on dist-test-slave-t3q3"
server_key: "606b7f7a99521c1962d6c9918d89f0a2"
server_key_iv: "c276133317565606b619ec4fd5b64e8e"
server_key_version: "encryptionkey@0"
I20260810 01:37:46.496253 8970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:46.509156 8970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:46.511785 8970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:46.511974 8970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:46.518611 8970 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:37143
I20260810 01:37:46.518656 9075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:37143 every 8 connection(s)
I20260810 01:37:46.519556 8970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:37:46.520191 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 8970
I20260810 01:37:46.520318 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:37:46.520654 25398 external_mini_cluster.cc:1428] Setting key 4a415550b378363348fce3bba7a3da88
I20260810 01:37:46.523013 9076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:46.529498 9076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a: Bootstrap starting.
Aug 10 01:37:46 dist-test-slave-t3q3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:46.532086 9076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:46.533002 9076 log.cc:824] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:46.535360 9076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a: No bootstrap required, opened a new log
I20260810 01:37:46.536049 9080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:46.522045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52546 (local address 127.24.205.190:37143)
0810 01:37:46.522463 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:46.522483 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:46.522523 (+ 40us) server_negotiation.cc:407] Connection header received
0810 01:37:46.523378 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:46.523402 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:46.523807 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:46.524197 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:46.524904 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:46.526442 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:46.527346 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:46.528086 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:46.528253 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:46.530795 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:46.530801 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:46.530817 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:46.530847 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:46.532846 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:46.533324 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:46.533330 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:46.533335 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:46.533492 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:46.533817 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:46.533820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:46.533821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:46.534340 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:46.534525 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:46.534801 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 01:37:46.535091 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":117,"threads_started":1}
I20260810 01:37:46.539290 9076 raft_consensus.cc:348] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c715b82aa1874a9e985a889b9ff00e6a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37143 } }
I20260810 01:37:46.539505 9076 raft_consensus.cc:374] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:46.539539 9076 raft_consensus.cc:729] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c715b82aa1874a9e985a889b9ff00e6a, State: Initialized, Role: FOLLOWER
I20260810 01:37:46.539934 9076 consensus_queue.cc:260] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c715b82aa1874a9e985a889b9ff00e6a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37143 } }
I20260810 01:37:46.540053 9076 raft_consensus.cc:388] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:37:46.540169 9076 raft_consensus.cc:482] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:37:46.540238 9076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:46.541245 9076 raft_consensus.cc:504] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c715b82aa1874a9e985a889b9ff00e6a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37143 } }
I20260810 01:37:46.541533 9076 leader_election.cc:302] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c715b82aa1874a9e985a889b9ff00e6a; no voters:
I20260810 01:37:46.541777 9076 leader_election.cc:288] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:37:46.541926 9082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:46.542202 9082 raft_consensus.cc:686] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [term 1 LEADER]: Becoming Leader. State: Replica: c715b82aa1874a9e985a889b9ff00e6a, State: Running, Role: LEADER
I20260810 01:37:46.542519 9082 consensus_queue.cc:237] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c715b82aa1874a9e985a889b9ff00e6a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37143 } }
I20260810 01:37:46.542973 9076 sys_catalog.cc:564] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:37:46.544293 9085 sys_catalog.cc:455] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c715b82aa1874a9e985a889b9ff00e6a. Latest consensus state: current_term: 1 leader_uuid: "c715b82aa1874a9e985a889b9ff00e6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c715b82aa1874a9e985a889b9ff00e6a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37143 } } }
I20260810 01:37:46.544263 9083 sys_catalog.cc:455] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c715b82aa1874a9e985a889b9ff00e6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c715b82aa1874a9e985a889b9ff00e6a" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37143 } } }
I20260810 01:37:46.544405 9085 sys_catalog.cc:458] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [sys.catalog]: This master's current role is: LEADER
I20260810 01:37:46.544405 9083 sys_catalog.cc:458] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a [sys.catalog]: This master's current role is: LEADER
W20260810 01:37:46.547860 9104 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:37:46.547955 9104 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:37:46.548033 9098 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:37:46.548758 9098 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:37:46.554242 9098 catalog_manager.cc:1347] Generated new cluster ID: f083ab124b0b42e09aaa4ade79cce1ee
I20260810 01:37:46.554311 9098 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:37:46.567655 9098 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:37:46.568868 9098 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:37:46.575526 9098 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a: Generated new TSK 0
I20260810 01:37:46.576272 9098 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:37:46.613801 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37143
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:46.733031 9113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:46.733433 9113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:46.733510 9113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:46.739214 9113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:46.739279 9113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:46.739339 9113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:37:46.744971 9113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:46.746029 9113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:46.747056 9113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:46.757007 9123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:46.757064 9125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:46.757061 9129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:46.757201 9113 server_base.cc:1034] running on GCE node
I20260810 01:37:46.757710 9113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:46.758270 9113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:46.759424 9113 hybrid_clock.cc:648] HybridClock initialized: now 1786325866759394 us; error 40 us; skew 500 ppm
Aug 10 01:37:46 dist-test-slave-t3q3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325866, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:46.762281 9113 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:37:46.763161 9113 webserver.cc:460] Webserver started at http://127.24.205.129:41079/ using document root <none> and password file <none>
I20260810 01:37:46.763839 9113 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:46.763942 9113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:46.764197 9113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:46.766224 9113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "858b68beb9c3426e9c334f50fbcfb68a"
format_stamp: "Formatted at 2026-08-10 01:37:46 on dist-test-slave-t3q3"
server_key: "208fedf3f591c02fd1d5d65973997d6c"
server_key_iv: "749167a672b4e1ac4bece0ac9fdf6e4e"
server_key_version: "encryptionkey@0"
I20260810 01:37:46.766748 9113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "858b68beb9c3426e9c334f50fbcfb68a"
format_stamp: "Formatted at 2026-08-10 01:37:46 on dist-test-slave-t3q3"
server_key: "208fedf3f591c02fd1d5d65973997d6c"
server_key_iv: "749167a672b4e1ac4bece0ac9fdf6e4e"
server_key_version: "encryptionkey@0"
I20260810 01:37:46.770479 9113 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:37:46.773015 9142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:46.774259 9113 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:46.774358 9113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "858b68beb9c3426e9c334f50fbcfb68a"
format_stamp: "Formatted at 2026-08-10 01:37:46 on dist-test-slave-t3q3"
server_key: "208fedf3f591c02fd1d5d65973997d6c"
server_key_iv: "749167a672b4e1ac4bece0ac9fdf6e4e"
server_key_version: "encryptionkey@0"
I20260810 01:37:46.774447 9113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:46.798882 9113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:46.802621 9113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:46.802789 9113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:46.803392 9113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:46.804306 9113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:46.804358 9113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:46.804401 9113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:46.804426 9113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:46.813823 9113 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:43165
I20260810 01:37:46.813850 9334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:43165 every 8 connection(s)
I20260810 01:37:46.814808 9113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:37:46.822187 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 9113
I20260810 01:37:46.822297 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:37:46.822619 25398 external_mini_cluster.cc:1428] Setting key 0aa5c7d9dfbbea05fbfffc7359b35746
Aug 10 01:37:46 dist-test-slave-t3q3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325866, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:46.830506 9080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:46.816853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:55877 (local address 127.24.205.190:37143)
0810 01:37:46.816998 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:46.817002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:46.817897 (+ 895us) server_negotiation.cc:407] Connection header received
0810 01:37:46.819237 (+ 1340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:46.819240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:46.819299 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:46.819380 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:46.820708 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:46.821286 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:46.822542 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:46.822853 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:46.822974 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:46.826125 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:46.826131 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:46.826137 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:46.826174 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:46.827776 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:46.828508 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:46.828511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:46.828512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:46.828594 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:46.829029 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:46.829032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:46.829033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:46.829287 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:46.829377 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:46.830187 (+ 810us) server_negotiation.cc:299] Negotiation successful
0810 01:37:46.830352 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:37:46.831784 9341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:46.817252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:37143 (local address 127.24.205.129:55877)
0810 01:37:46.817730 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:46.817776 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:46.819012 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:46.819559 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:46.819566 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:46.819945 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:46.820544 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:46.820559 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:46.821410 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:46.821413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:46.822409 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:46.822419 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:46.823020 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:46.823024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:46.823266 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:46.824026 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:46.824050 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:46.825904 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:46.827908 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:46.827918 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:46.827938 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:46.828402 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:46.828693 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:46.828699 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:46.828704 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:46.828917 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:46.829411 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:46.829422 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:46.829833 (+ 411us) client_negotiation.cc:769] Sending connection context
0810 01:37:46.830094 (+ 261us) client_negotiation.cc:240] Negotiation successful
0810 01:37:46.830508 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":118,"threads_started":1}
I20260810 01:37:46.833344 9335 heartbeater.cc:347] Connected to a master server at 127.24.205.190:37143
I20260810 01:37:46.833621 9335 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:46.834157 9335 heartbeater.cc:511] Master 127.24.205.190:37143 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:37:46.835743 9021 ts_manager.cc:194] Registered new tserver with Master: 858b68beb9c3426e9c334f50fbcfb68a (127.24.205.129:43165)
I20260810 01:37:46.836989 9021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:55877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:37:46.854704 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37143
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:46.978080 9347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:46.978356 9347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:46.978432 9347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:46.982499 9347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:46.982569 9347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:46.982676 9347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:37:46.988368 9347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:46.989553 9347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:46.990665 9347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:47.000710 9354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:47.000708 9356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:47.000787 9347 server_base.cc:1034] running on GCE node
W20260810 01:37:47.000706 9361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:47.001434 9347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:47.002048 9347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:47.003223 9347 hybrid_clock.cc:648] HybridClock initialized: now 1786325867003203 us; error 30 us; skew 500 ppm
Aug 10 01:37:47 dist-test-slave-t3q3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325867, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:47.006309 9347 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:37:47.007269 9347 webserver.cc:460] Webserver started at http://127.24.205.130:41543/ using document root <none> and password file <none>
I20260810 01:37:47.007839 9347 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:47.007903 9347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:47.008184 9347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:47.010272 9347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "066e1a00508f466181ac81129a9ad9ed"
format_stamp: "Formatted at 2026-08-10 01:37:47 on dist-test-slave-t3q3"
server_key: "0dff53c6e9db2d8621ace18a5044a932"
server_key_iv: "3db10a011912831acb96080deef92523"
server_key_version: "encryptionkey@0"
I20260810 01:37:47.010862 9347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "066e1a00508f466181ac81129a9ad9ed"
format_stamp: "Formatted at 2026-08-10 01:37:47 on dist-test-slave-t3q3"
server_key: "0dff53c6e9db2d8621ace18a5044a932"
server_key_iv: "3db10a011912831acb96080deef92523"
server_key_version: "encryptionkey@0"
I20260810 01:37:47.014817 9347 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 01:37:47.017423 9371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:47.018718 9347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:37:47.018869 9347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "066e1a00508f466181ac81129a9ad9ed"
format_stamp: "Formatted at 2026-08-10 01:37:47 on dist-test-slave-t3q3"
server_key: "0dff53c6e9db2d8621ace18a5044a932"
server_key_iv: "3db10a011912831acb96080deef92523"
server_key_version: "encryptionkey@0"
I20260810 01:37:47.018992 9347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:47.030733 9347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:47.034385 9347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:47.034621 9347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:47.035254 9347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:47.036197 9347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:47.036269 9347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:47.036345 9347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:47.036391 9347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:47.046018 9347 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:45715
I20260810 01:37:47.046042 9561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:45715 every 8 connection(s)
I20260810 01:37:47.046957 9347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:37:47.052875 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 9347
I20260810 01:37:47.053014 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:37:47.053334 25398 external_mini_cluster.cc:1428] Setting key 27d579ecc3f107ac0b86cba07a6e8318
Aug 10 01:37:47 dist-test-slave-t3q3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325867, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:47.062268 9080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.048905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:55605 (local address 127.24.205.190:37143)
0810 01:37:47.049046 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.049050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.049915 (+ 865us) server_negotiation.cc:407] Connection header received
0810 01:37:47.051376 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.051379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.051440 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.051547 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:47.053010 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.053688 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.055182 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.055399 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.055493 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.058403 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:47.058407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:47.058410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:47.058433 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:47.059986 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:47.060667 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:47.060672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:47.060674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:47.060761 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:47.061136 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:47.061139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:47.061141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:47.061335 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:47.061448 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.061978 (+ 530us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.062104 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:37:47.063104 9576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.049305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:37143 (local address 127.24.205.130:55605)
0810 01:37:47.049762 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.049805 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:47.051152 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:47.051725 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:47.051733 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:47.052192 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:47.052782 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.052805 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.053828 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.053831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.055051 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.055062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.055558 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.055564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.055795 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.056491 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:47.056517 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:47.058222 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:47.060161 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:47.060167 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:47.060183 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:47.060556 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:47.060859 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:47.060862 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:47.060864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:47.061013 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:47.061458 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:47.061467 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:47.061725 (+ 258us) client_negotiation.cc:769] Sending connection context
0810 01:37:47.061919 (+ 194us) client_negotiation.cc:240] Negotiation successful
0810 01:37:47.062270 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":130,"threads_started":1}
I20260810 01:37:47.064435 9567 heartbeater.cc:347] Connected to a master server at 127.24.205.190:37143
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:37:47.064738 9567 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:47.065256 9567 heartbeater.cc:511] Master 127.24.205.190:37143 requested a full tablet report, sending...
I20260810 01:37:47.066401 9021 ts_manager.cc:194] Registered new tserver with Master: 066e1a00508f466181ac81129a9ad9ed (127.24.205.130:45715)
I20260810 01:37:47.066952 9021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:55605
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:37:47.083318 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37143
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:37:47.195740 9580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:37:47.195995 9580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:37:47.196044 9580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:37:47.200098 9580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:37:47.200166 9580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:37:47.200258 9580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:37:47.205529 9580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:37:47.206619 9580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:37:47.207633 9580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:37:47.217347 9591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:47.217355 9595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:37:47.217355 9590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:37:47.217391 9580 server_base.cc:1034] running on GCE node
I20260810 01:37:47.218025 9580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:37:47.218576 9580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:37:47.219745 9580 hybrid_clock.cc:648] HybridClock initialized: now 1786325867219710 us; error 50 us; skew 500 ppm
Aug 10 01:37:47 dist-test-slave-t3q3 krb5kdc[8947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325867, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:37:47.222576 9580 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:37:47.223395 9580 webserver.cc:460] Webserver started at http://127.24.205.131:41895/ using document root <none> and password file <none>
I20260810 01:37:47.223894 9580 fs_manager.cc:359] Metadata directory not provided
I20260810 01:37:47.223951 9580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:37:47.224189 9580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:37:47.226142 9580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b"
format_stamp: "Formatted at 2026-08-10 01:37:47 on dist-test-slave-t3q3"
server_key: "dc41edd9d7c57571d904185c6c6d70bb"
server_key_iv: "7f1948248d371a54f29ba90e0258f1fa"
server_key_version: "encryptionkey@0"
I20260810 01:37:47.226645 9580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b"
format_stamp: "Formatted at 2026-08-10 01:37:47 on dist-test-slave-t3q3"
server_key: "dc41edd9d7c57571d904185c6c6d70bb"
server_key_iv: "7f1948248d371a54f29ba90e0258f1fa"
server_key_version: "encryptionkey@0"
I20260810 01:37:47.230357 9580 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:37:47.232743 9606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:47.233952 9580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:37:47.234056 9580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b"
format_stamp: "Formatted at 2026-08-10 01:37:47 on dist-test-slave-t3q3"
server_key: "dc41edd9d7c57571d904185c6c6d70bb"
server_key_iv: "7f1948248d371a54f29ba90e0258f1fa"
server_key_version: "encryptionkey@0"
I20260810 01:37:47.234187 9580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:37:47.268249 9580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:37:47.271795 9580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:37:47.272037 9580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:37:47.272776 9580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:37:47.273731 9580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:37:47.273793 9580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:47.273876 9580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:37:47.273917 9580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:37:47.284300 9580 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:33585
I20260810 01:37:47.284335 9794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:33585 every 8 connection(s)
I20260810 01:37:47.285269 9580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:37:47.290781 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 9580
I20260810 01:37:47.290889 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:37:47.291256 25398 external_mini_cluster.cc:1428] Setting key f66bc7f3fdef5f5bf32e327646475a91
Aug 10 01:37:47 dist-test-slave-t3q3 krb5kdc[8947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325867, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:37:47.300225 9080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.287408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:46215 (local address 127.24.205.190:37143)
0810 01:37:47.287567 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.287571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.288479 (+ 908us) server_negotiation.cc:407] Connection header received
0810 01:37:47.289908 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.289911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.289971 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.290047 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:47.291398 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.292178 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.293741 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.293977 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.294066 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.296516 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:47.296519 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:47.296521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:47.296553 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:47.298058 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:47.298546 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:47.298550 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:47.298551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:47.298641 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:47.298994 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:47.298997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:47.298998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:47.299212 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:47.299301 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.299898 (+ 597us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.300035 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:37:47.301080 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.287820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:37143 (local address 127.24.205.131:46215)
0810 01:37:47.288323 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.288367 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:47.289692 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:47.290264 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:47.290271 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:47.290627 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:37:47.291216 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.291231 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.292357 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.292360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.293602 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.293617 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.294120 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.294122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.294265 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.294807 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:37:47.294832 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:37:47.296357 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:37:47.298176 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:47.298181 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:47.298193 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:47.298444 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:47.298730 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:37:47.298732 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:37:47.298733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:37:47.298877 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:37:47.299312 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:37:47.299317 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:37:47.299638 (+ 321us) client_negotiation.cc:769] Sending connection context
0810 01:37:47.299852 (+ 214us) client_negotiation.cc:240] Negotiation successful
0810 01:37:47.300212 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":121,"threads_started":1}
I20260810 01:37:47.302346 9795 heartbeater.cc:347] Connected to a master server at 127.24.205.190:37143
I20260810 01:37:47.302621 9795 heartbeater.cc:464] Registering TS with master...
I20260810 01:37:47.303143 9795 heartbeater.cc:511] Master 127.24.205.190:37143 requested a full tablet report, sending...
I20260810 01:37:47.304369 9021 ts_manager.cc:194] Registered new tserver with Master: 91b8e7ae3fcf41ed8f8d083ae7ec367b (127.24.205.131:33585)
I20260810 01:37:47.305053 9021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:46215
I20260810 01:37:47.305647 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:37:47.315824 9080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.307932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.24.205.190:37143)
0810 01:37:47.308097 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.308102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.308441 (+ 339us) server_negotiation.cc:407] Connection header received
0810 01:37:47.308514 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.308516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.308568 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.308638 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:37:47.309357 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.309884 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.310688 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.310902 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.310984 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.312724 (+ 1740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:37:47.312727 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:37:47.312729 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:37:47.312751 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:37:47.314054 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:47.314482 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:47.314485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:47.314486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:47.314575 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:37:47.314919 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:37:47.314922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:37:47.314923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:37:47.315155 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:37:47.315270 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.315524 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.315623 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:37:47.319070 9018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52556:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:37:47.322306 9018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:37:47.337972 9818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.331223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:33585 (local address 127.0.0.1:35960)
0810 01:37:47.331831 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.331888 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:47.332039 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:47.333170 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:47.333176 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:47.333202 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:47.333355 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.333369 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.334886 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.334889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.336035 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.336045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.337238 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.337242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.337442 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.337532 (+ 90us) client_negotiation.cc:769] Sending connection context
0810 01:37:47.337655 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 01:37:47.337797 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":185,"thread_start_us":89,"threads_started":1}
I20260810 01:37:47.338050 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.331344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35960 (local address 127.24.205.131:33585)
0810 01:37:47.332604 (+ 1260us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.332617 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.332642 (+ 25us) server_negotiation.cc:407] Connection header received
0810 01:37:47.332726 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.332733 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.332963 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.333172 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:47.333502 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.334731 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.336234 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.337093 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.337229 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.337368 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.337752 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.337885 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1145,"thread_start_us":98,"threads_started":1}
I20260810 01:37:47.337989 9825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.331577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43165 (local address 127.0.0.1:43300)
0810 01:37:47.332229 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.332242 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:47.332330 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:47.333447 (+ 1117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:47.333449 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:47.333462 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:47.333549 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.333556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.334873 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.334876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.336181 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.336193 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.337239 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.337242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.337447 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.337530 (+ 83us) client_negotiation.cc:769] Sending connection context
0810 01:37:47.337655 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 01:37:47.337838 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":103,"spinlock_wait_cycles":3712,"thread_start_us":104,"threads_started":1}
I20260810 01:37:47.338990 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.331294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:45715 (local address 127.0.0.1:39346)
0810 01:37:47.332207 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.332221 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:47.332330 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:47.333379 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:47.333382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:47.333429 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:47.333549 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.333556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.334611 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.334617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.336181 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.336193 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.338550 (+ 2357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.338554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.338659 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.338682 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:37:47.338760 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:37:47.338844 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"mutex_wait_us":55,"spinlock_wait_cycles":7808,"thread_start_us":104,"threads_started":1}
I20260810 01:37:47.339462 9827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.332582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43300 (local address 127.24.205.129:43165)
0810 01:37:47.332985 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.332999 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.333019 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:37:47.333082 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.333112 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.333309 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.333475 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:47.333650 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.334738 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.336292 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.337093 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.337231 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.337368 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.339194 (+ 1826us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.339309 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":91,"threads_started":1}
I20260810 01:37:47.341408 9682 tablet_service.cc:1467] Processing CreateTablet for tablet 4425a9767e87488d90b2e7747a742854 (DEFAULT_TABLE table=test-table [id=cd301fe4424244c6835849e67b9adf58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:47.339222 9826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.332229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39346 (local address 127.24.205.130:45715)
0810 01:37:47.332785 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.332798 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.332819 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:37:47.332899 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.332904 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.333095 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.333227 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:47.333713 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.334461 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.337440 (+ 2979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.338228 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.338351 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.338489 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.338797 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.338898 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":162,"threads_started":1}
I20260810 01:37:47.341879 9225 tablet_service.cc:1467] Processing CreateTablet for tablet 4425a9767e87488d90b2e7747a742854 (DEFAULT_TABLE table=test-table [id=cd301fe4424244c6835849e67b9adf58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:47.342626 9682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4425a9767e87488d90b2e7747a742854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:47.342969 9225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4425a9767e87488d90b2e7747a742854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:47.344805 9450 tablet_service.cc:1467] Processing CreateTablet for tablet 4425a9767e87488d90b2e7747a742854 (DEFAULT_TABLE table=test-table [id=cd301fe4424244c6835849e67b9adf58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:37:47.345871 9450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4425a9767e87488d90b2e7747a742854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:37:47.349624 9828 tablet_bootstrap.cc:492] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Bootstrap starting.
I20260810 01:37:47.350988 9830 tablet_bootstrap.cc:492] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: Bootstrap starting.
I20260810 01:37:47.352545 9828 tablet_bootstrap.cc:654] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:47.353199 9830 tablet_bootstrap.cc:654] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:47.353775 9831 tablet_bootstrap.cc:492] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Bootstrap starting.
I20260810 01:37:47.353861 9828 log.cc:824] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:47.354427 9830 log.cc:824] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:47.355949 9828 tablet_bootstrap.cc:492] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: No bootstrap required, opened a new log
I20260810 01:37:47.356215 9828 ts_tablet_manager.cc:1397] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:37:47.356637 9830 tablet_bootstrap.cc:492] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: No bootstrap required, opened a new log
I20260810 01:37:47.356637 9831 tablet_bootstrap.cc:654] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Neither blocks nor log segments found. Creating new log.
I20260810 01:37:47.356851 9830 ts_tablet_manager.cc:1397] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:37:47.357506 9831 log.cc:824] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Log is configured to *not* fsync() on all Append() calls
I20260810 01:37:47.359755 9831 tablet_bootstrap.cc:492] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: No bootstrap required, opened a new log
I20260810 01:37:47.359954 9831 ts_tablet_manager.cc:1397] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:37:47.359767 9828 raft_consensus.cc:348] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.360126 9828 raft_consensus.cc:374] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:47.360208 9828 raft_consensus.cc:729] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b8e7ae3fcf41ed8f8d083ae7ec367b, State: Initialized, Role: FOLLOWER
I20260810 01:37:47.360787 9828 consensus_queue.cc:260] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.361655 9795 heartbeater.cc:503] Master 127.24.205.190:37143 was elected leader, sending a full tablet report...
I20260810 01:37:47.362021 9828 ts_tablet_manager.cc:1428] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:37:47.361361 9830 raft_consensus.cc:348] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.362970 9830 raft_consensus.cc:374] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:47.363075 9830 raft_consensus.cc:729] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858b68beb9c3426e9c334f50fbcfb68a, State: Initialized, Role: FOLLOWER
I20260810 01:37:47.363564 9830 consensus_queue.cc:260] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.363813 9831 raft_consensus.cc:348] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.364104 9831 raft_consensus.cc:374] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:37:47.364210 9831 raft_consensus.cc:729] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066e1a00508f466181ac81129a9ad9ed, State: Initialized, Role: FOLLOWER
I20260810 01:37:47.364641 9830 ts_tablet_manager.cc:1428] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260810 01:37:47.364653 9831 consensus_queue.cc:260] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.365013 9335 heartbeater.cc:503] Master 127.24.205.190:37143 was elected leader, sending a full tablet report...
I20260810 01:37:47.365617 9831 ts_tablet_manager.cc:1428] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260810 01:37:47.366068 9567 heartbeater.cc:503] Master 127.24.205.190:37143 was elected leader, sending a full tablet report...
W20260810 01:37:47.536309 9796 tablet.cc:2369] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:47.548233 9574 tablet.cc:2369] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:37:47.566105 9339 tablet.cc:2369] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:37:47.634174 9838 raft_consensus.cc:482] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:37:47.634379 9838 raft_consensus.cc:504] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.635607 9838 leader_election.cc:288] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 066e1a00508f466181ac81129a9ad9ed (127.24.205.130:45715), 858b68beb9c3426e9c334f50fbcfb68a (127.24.205.129:43165)
I20260810 01:37:47.640157 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.635834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:45715 (local address 127.24.205.131:38633)
0810 01:37:47.636144 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.636163 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:47.636274 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:47.636600 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:47.636603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:47.636627 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:47.636767 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.636778 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.637634 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.637640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.638984 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.638996 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.639652 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.639656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.639773 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.639813 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 01:37:47.639893 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 01:37:47.639963 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":39}
I20260810 01:37:47.640174 9826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.635936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:38633 (local address 127.24.205.130:45715)
0810 01:37:47.636087 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.636093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.636318 (+ 225us) server_negotiation.cc:407] Connection header received
0810 01:37:47.636390 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.636393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.636467 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.636565 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:47.636905 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.637499 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.639130 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.639521 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.639618 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.639668 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.639931 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.640025 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:37:47.640295 9827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.636127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:36315 (local address 127.24.205.129:43165)
0810 01:37:47.636270 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.636274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.636570 (+ 296us) server_negotiation.cc:407] Connection header received
0810 01:37:47.636648 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.636651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.636700 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.636795 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:37:47.637119 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.637725 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.639173 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.639641 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.639761 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.639818 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.640086 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.640168 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:37:47.640327 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.635952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43165 (local address 127.24.205.131:36315)
0810 01:37:47.636410 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.636430 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 01:37:47.636543 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:37:47.636814 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:37:47.636817 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:37:47.636831 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:37:47.636976 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.636983 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.637847 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.637850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.639014 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:37:47.639022 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.639781 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.639784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:37:47.639920 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.639945 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:37:47.640022 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:37:47.640112 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":55,"thread_start_us":149,"threads_started":1}
I20260810 01:37:47.640872 9476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425a9767e87488d90b2e7747a742854" candidate_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066e1a00508f466181ac81129a9ad9ed" is_pre_election: true
I20260810 01:37:47.640918 9256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425a9767e87488d90b2e7747a742854" candidate_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858b68beb9c3426e9c334f50fbcfb68a" is_pre_election: true
I20260810 01:37:47.641234 9256 raft_consensus.cc:2454] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b8e7ae3fcf41ed8f8d083ae7ec367b in term 0.
I20260810 01:37:47.641232 9476 raft_consensus.cc:2454] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b8e7ae3fcf41ed8f8d083ae7ec367b in term 0.
I20260810 01:37:47.641776 9608 leader_election.cc:302] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 066e1a00508f466181ac81129a9ad9ed, 858b68beb9c3426e9c334f50fbcfb68a, 91b8e7ae3fcf41ed8f8d083ae7ec367b; no voters:
I20260810 01:37:47.642061 9838 raft_consensus.cc:2781] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:37:47.642140 9838 raft_consensus.cc:482] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:37:47.642195 9838 raft_consensus.cc:3037] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:47.643392 9838 raft_consensus.cc:504] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.643819 9838 leader_election.cc:288] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [CANDIDATE]: Term 1 election: Requested vote from peers 066e1a00508f466181ac81129a9ad9ed (127.24.205.130:45715), 858b68beb9c3426e9c334f50fbcfb68a (127.24.205.129:43165)
I20260810 01:37:47.644197 9476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425a9767e87488d90b2e7747a742854" candidate_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066e1a00508f466181ac81129a9ad9ed"
I20260810 01:37:47.644273 9256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4425a9767e87488d90b2e7747a742854" candidate_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858b68beb9c3426e9c334f50fbcfb68a"
I20260810 01:37:47.644335 9476 raft_consensus.cc:3037] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:47.644426 9256 raft_consensus.cc:3037] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:37:47.645546 9476 raft_consensus.cc:2454] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b8e7ae3fcf41ed8f8d083ae7ec367b in term 1.
I20260810 01:37:47.645670 9256 raft_consensus.cc:2454] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b8e7ae3fcf41ed8f8d083ae7ec367b in term 1.
I20260810 01:37:47.645864 9613 leader_election.cc:302] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066e1a00508f466181ac81129a9ad9ed, 91b8e7ae3fcf41ed8f8d083ae7ec367b; no voters:
I20260810 01:37:47.646082 9838 raft_consensus.cc:2781] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:37:47.646314 9838 raft_consensus.cc:686] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 1 LEADER]: Becoming Leader. State: Replica: 91b8e7ae3fcf41ed8f8d083ae7ec367b, State: Running, Role: LEADER
I20260810 01:37:47.646698 9838 consensus_queue.cc:237] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } }
I20260810 01:37:47.650256 9021 catalog_manager.cc:5495] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b reported cstate change: term changed from 0 to 1, leader changed from <none> to 91b8e7ae3fcf41ed8f8d083ae7ec367b (127.24.205.131). New cstate: current_term: 1 leader_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91b8e7ae3fcf41ed8f8d083ae7ec367b" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 } health_report { overall_health: UNKNOWN } } }
I20260810 01:37:47.701874 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.698141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35962 (local address 127.24.205.131:33585)
0810 01:37:47.698285 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 01:37:47.698290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:37:47.698307 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:37:47.698407 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:37:47.698409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:37:47.698468 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:37:47.698605 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:37:47.698864 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.699393 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.700340 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:37:47.700571 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:37:47.700688 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:37:47.701007 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:37:47.701450 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:37:47.701600 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 01:37:47.701671 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 01:37:47.701728 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:37:47.708050 9476 raft_consensus.cc:1261] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 1 FOLLOWER]: Refusing update from remote peer 91b8e7ae3fcf41ed8f8d083ae7ec367b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:47.708020 9256 raft_consensus.cc:1261] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 1 FOLLOWER]: Refusing update from remote peer 91b8e7ae3fcf41ed8f8d083ae7ec367b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:37:47.708885 9847 consensus_queue.cc:1035] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [LEADER]: Connected to new peer: Peer: permanent_uuid: "858b68beb9c3426e9c334f50fbcfb68a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:47.709090 9838 consensus_queue.cc:1035] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [LEADER]: Connected to new peer: Peer: permanent_uuid: "066e1a00508f466181ac81129a9ad9ed" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 45715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:37:47.716310 9851 mvcc.cc:205] Tried to move back new op lower bound from 7316790754124341248 to 7316790753883385856. Current Snapshot: MvccSnapshot[applied={T|T < 7316790754124341248}]
I20260810 01:37:47.718370 9856 mvcc.cc:205] Tried to move back new op lower bound from 7316790754124341248 to 7316790753883385856. Current Snapshot: MvccSnapshot[applied={T|T < 7316790754124341248}]
I20260810 01:37:47.727216 9021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:47.727420 9021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:37:47.730225 9021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c715b82aa1874a9e985a889b9ff00e6a: Sending DeleteTablet for 3 replicas of tablet 4425a9767e87488d90b2e7747a742854
I20260810 01:37:47.731086 9450 tablet_service.cc:1514] Processing DeleteTablet for tablet 4425a9767e87488d90b2e7747a742854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:47 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:39346
I20260810 01:37:47.731083 9682 tablet_service.cc:1514] Processing DeleteTablet for tablet 4425a9767e87488d90b2e7747a742854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:47 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:35960
I20260810 01:37:47.731278 9225 tablet_service.cc:1514] Processing DeleteTablet for tablet 4425a9767e87488d90b2e7747a742854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:37:47 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:43300
I20260810 01:37:47.731848 9867 tablet_replica.cc:330] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: stopping tablet replica
I20260810 01:37:47.732038 9869 tablet_replica.cc:330] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a: stopping tablet replica
I20260810 01:37:47.732297 9867 raft_consensus.cc:2229] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:47.732482 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 9113
I20260810 01:37:47.732450 9869 raft_consensus.cc:2229] T 4425a9767e87488d90b2e7747a742854 P 858b68beb9c3426e9c334f50fbcfb68a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:37:47.735414 9867 raft_consensus.cc:2258] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:47.735807 9868 tablet_replica.cc:330] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: stopping tablet replica
I20260810 01:37:47.736135 9868 raft_consensus.cc:2229] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:37:47.736568 9868 raft_consensus.cc:2258] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:37:47.738263 9867 ts_tablet_manager.cc:1905] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:47.741305 9867 ts_tablet_manager.cc:1918] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:47.741407 9867 log.cc:1196] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/4425a9767e87488d90b2e7747a742854
I20260810 01:37:47.741731 9867 ts_tablet_manager.cc:1939] T 4425a9767e87488d90b2e7747a742854 P 066e1a00508f466181ac81129a9ad9ed: Deleting consensus metadata
I20260810 01:37:47.743146 9001 catalog_manager.cc:4841] TS 066e1a00508f466181ac81129a9ad9ed (127.24.205.130:45715): tablet 4425a9767e87488d90b2e7747a742854 (table test-table [id=cd301fe4424244c6835849e67b9adf58]) successfully deleted
I20260810 01:37:47.747579 9868 ts_tablet_manager.cc:1905] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:37:47.750522 9868 ts_tablet_manager.cc:1918] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:37:47.750656 9868 log.cc:1196] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/4425a9767e87488d90b2e7747a742854
I20260810 01:37:47.751040 9868 ts_tablet_manager.cc:1939] T 4425a9767e87488d90b2e7747a742854 P 91b8e7ae3fcf41ed8f8d083ae7ec367b: Deleting consensus metadata
I20260810 01:37:47.752446 8999 catalog_manager.cc:4841] TS 91b8e7ae3fcf41ed8f8d083ae7ec367b (127.24.205.131:33585): tablet 4425a9767e87488d90b2e7747a742854 (table test-table [id=cd301fe4424244c6835849e67b9adf58]) successfully deleted
W20260810 01:37:47.753684 8996 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:43165 (error 108)
I20260810 01:37:47.754679 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 9347
I20260810 01:37:47.754875 9818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:37:47.754522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43165 (local address 127.0.0.1:43308)
0810 01:37:47.754679 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 01:37:47.754768 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260810 01:37:47.773072 8996 catalog_manager.cc:4584] TS 858b68beb9c3426e9c334f50fbcfb68a (127.24.205.129:43165): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4425a9767e87488d90b2e7747a742854: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43165: connect: Connection refused (error 111)
I20260810 01:37:47.778784 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 9580
I20260810 01:37:47.795975 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 8970
2026-08-10T01:37:47Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2895 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:37:47 dist-test-slave-t3q3 krb5kdc[9877](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:37:47 dist-test-slave-t3q3 krb5kdc[9877](info): set up 2 sockets
Aug 10 01:37:47 dist-test-slave-t3q3 krb5kdc[9877](info): commencing operation
krb5kdc: starting...
W20260810 01:37:49.063016 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:37:49 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:37:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:37:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/rangeradmin_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/rangeradmin_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/rangerlookup_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/rangerlookup_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
I20260810 01:37:49.248832 25398 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdl8Mys/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/postgres -l logfile start
2026-08-10 01:37:51.704 UTC [9947] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 01:37:51.704 UTC [9947] LOG: listening on IPv4 address "127.24.205.148", port 56619
2026-08-10 01:37:51.707 UTC [9947] LOG: listening on Unix socket "/tmp/.s.PGSQL.56619"
2026-08-10 01:37:51.729 UTC [9951] LOG: database system was shut down at 2026-08-10 01:37:50 UTC
2026-08-10 01:37:51.732 UTC [9947] LOG: database system is ready to accept connections
I20260810 01:37:52.907281 25398 mini_postgres.cc:96] Postgres bound to 56619
2026-08-10 01:37:52.915 UTC [9961] FATAL: database "slave" does not exist
127.24.205.148:56619 - accepting connections
I20260810 01:37:52.916304 25398 mini_ranger.cc:161] Starting Ranger...
I20260810 01:37:52.934234 25398 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 01:37:53.412328 25398 mini_ranger.cc:87] Created ranger Postgres database
I20260810 01:37:53.412420 25398 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-admin
2026-08-10 01:37:53,697 [I] DB FLAVOR :POSTGRES
2026-08-10 01:37:53,698 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:37:53,698 [I] Checking connection..
2026-08-10 01:37:53,698 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 01:37:53,980 [I] Checking connection passed.
2026-08-10 01:37:53,980 [I] --------- Verifying version history table ---------
2026-08-10 01:37:53,980 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:37:54,274 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:37:54,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:37:54,520 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:37:54,521 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 01:37:54,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 01:37:54.789 UTC [10069] WARNING: there is no transaction in progress
2026-08-10 01:37:54,799 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 01:37:54,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:37:55,061 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 01:37:55,061 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:37:55,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 01:37:55,306 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 01:37:55,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t3q3.c.gcp-upstream.internal','N') ;"
2026-08-10 01:37:55,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:37:56,115 [I] Table x_portal_user does not exist in database ranger
2026-08-10 01:37:56,116 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:37:56,384 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 01:37:56,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:37:56,628 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:37:56,896 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 01:37:56,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 01:37:57.874 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:57.891 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:57.908 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:57.924 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:57.941 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:57.959 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.021 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.028 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.042 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.051 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.061 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.076 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.086 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.092 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.099 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58.106 UTC [10243] WARNING: there is no transaction in progress
2026-08-10 01:37:58,755 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 01:37:58,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 01:37:59,008 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 01:37:59,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:37:59,278 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 01:37:59,278 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:37:59,545 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 01:37:59,545 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:37:59,783 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:38:00,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t3q3.c.gcp-upstream.internal';"
2026-08-10 01:38:00,274 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 01:38:00,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 01:38:00,534 [I] DB_PATCHES have already been applied
I20260810 01:38:00.540006 25398 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdl8Mys/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 01:38:00.540122 25398 mini_ranger.cc:193] Using host: 127.24.205.148
I20260810 01:38:00.545017 25398 mini_ranger.cc:227] Ranger admin URL: http://127.24.205.148:55067
Aug 10, 2026 1:38:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:38:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:38:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 1:38:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 1:38:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 1:38:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 1:38:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 01:38:01.919277 25398 mini_ranger.cc:160] Time spent starting Ranger: real 9.003s user 0.002s sys 0.013s
Aug 10, 2026 1:38:22 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 1:38:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 1:38:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 1:38:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 1:38:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 01:38:24.513006 25398 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/rangerkms_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/rangerkms_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.205.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.205.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 01:38:24 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325904, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 01:38:24.631270 25398 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 01:38:24.644958 25398 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 01:38:25.470301 25398 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 01:38:25.470388 25398 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms
I20260810 01:38:25.470498 25398 mini_ranger_kms.cc:227] Using postgres at 127.24.205.148:56619
2026-08-10 01:38:26,029 [I] DB FLAVOR :POSTGRES
2026-08-10 01:38:26,030 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:38:26,030 [I] Checking connection
2026-08-10 01:38:26,030 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 01:38:26,375 [I] connection success
2026-08-10 01:38:26,376 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 01:38:26,376 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 01:38:26,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 01:38:26,662 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 01:38:26,662 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:38:26,662 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 01:38:26,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:56619/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 01:38:26,933 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 01:38:27.410717 25398 mini_ranger_kms.cc:310] Created kms service
I20260810 01:38:27.640986 25398 mini_ranger_kms.cc:326] Created kudu user
I20260810 01:38:27.687953 25398 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 01:38:27 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325904, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:38:28.129202 25398 mini_ranger_kms.cc:384] Added ranger policy
I20260810 01:38:28.129362 25398 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 01:38:28.129387 25398 mini_ranger_kms.cc:240] Using host: 127.24.205.148
I20260810 01:38:28.134946 25398 mini_ranger_kms.cc:276] Ranger KMS PID: 10589
I20260810 01:38:28.135093 25398 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.205.148:41361
Aug 10, 2026 1:38:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:38:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:38:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 1:38:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 1:38:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 1:38:29 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 01:38:30 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786325910, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.205.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:38:30.955700 25398 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.324s user 0.018s sys 0.516s
I20260810 01:38:30.955875 25398 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 01:38:30.956025 25398 mini_ranger_kms.cc:401] 127.24.205.148:41361/kms/v1/keys
Aug 10 01:38:31 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325910, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.205.148@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
Aug 10 01:38:31 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325910, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.205.148@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
Aug 10 01:38:34 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:38:34.351586 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43955
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:43955
--ranger_config_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:41361/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:38:34.507030 10672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:38:34.507306 10672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:38:34.507349 10672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:38:34.511531 10672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:38:34.511590 10672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:38:34.511608 10672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:38:34.511626 10672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:38:34.511667 10672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:38:34.517329 10672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.205.148:41361/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:43955
--ranger_config_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:38:34.518450 10672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:38:34.519573 10672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:38:34.529778 10688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:38:34.529845 10672 server_base.cc:1034] running on GCE node
W20260810 01:38:34.529771 10683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:38:34.529737 10682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:38:34.530501 10672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:38:34.531582 10672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:38:34.532750 10672 hybrid_clock.cc:648] HybridClock initialized: now 1786325914532729 us; error 34 us; skew 500 ppm
Aug 10 01:38:34 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325914, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:38:34.536131 10672 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:38:34.537019 10672 webserver.cc:460] Webserver started at http://127.24.205.190:41499/ using document root <none> and password file <none>
I20260810 01:38:34.537559 10672 fs_manager.cc:359] Metadata directory not provided
I20260810 01:38:34.537622 10672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:38:34.537842 10672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:38:34 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325914, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:38:34.599644 10672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "31267c49b1b64010af5ff8d3455e21c3"
format_stamp: "Formatted at 2026-08-10 01:38:34 on dist-test-slave-t3q3"
server_key: "06098941271c3df0df47b89b1ea42a6f"
server_key_iv: "30145abe0c01b5dff91ae6db34446bd2"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:34.600474 10672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "31267c49b1b64010af5ff8d3455e21c3"
format_stamp: "Formatted at 2026-08-10 01:38:34 on dist-test-slave-t3q3"
server_key: "06098941271c3df0df47b89b1ea42a6f"
server_key_iv: "30145abe0c01b5dff91ae6db34446bd2"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:34.604950 10672 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 01:38:34.620229 10696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:34.621801 10672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:38:34.621968 10672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "31267c49b1b64010af5ff8d3455e21c3"
format_stamp: "Formatted at 2026-08-10 01:38:34 on dist-test-slave-t3q3"
server_key: "06098941271c3df0df47b89b1ea42a6f"
server_key_iv: "30145abe0c01b5dff91ae6db34446bd2"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:34.622135 10672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:38:34.634454 10672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:38:34.637897 10672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:38:34.638486 10672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:38:34.652549 10672 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:43955
I20260810 01:38:34.652669 10784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:43955 every 8 connection(s)
I20260810 01:38:34.653779 10672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:38:34.657225 10787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:38:34.661806 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 10672
I20260810 01:38:34.661942 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:38:34.662272 25398 external_mini_cluster.cc:1428] Setting key 2c23a36b0d3617daf56d92b1348e0045
I20260810 01:38:34.664779 10787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3: Bootstrap starting.
I20260810 01:38:34.667714 10787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3: Neither blocks nor log segments found. Creating new log.
I20260810 01:38:34.668928 10787 log.cc:824] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3: Log is configured to *not* fsync() on all Append() calls
I20260810 01:38:34.671185 10787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3: No bootstrap required, opened a new log
Aug 10 01:38:34 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:38:34.676323 10787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31267c49b1b64010af5ff8d3455e21c3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43955 } }
I20260810 01:38:34.676582 10787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:38:34.676671 10787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31267c49b1b64010af5ff8d3455e21c3, State: Initialized, Role: FOLLOWER
I20260810 01:38:34.677193 10787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31267c49b1b64010af5ff8d3455e21c3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43955 } }
I20260810 01:38:34.677357 10787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:38:34.677472 10787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:38:34.677591 10787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:38:34.678984 10793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:34.664113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59358 (local address 127.24.205.190:43955)
0810 01:38:34.664715 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:34.664750 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:34.664787 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:38:34.665796 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:34.665815 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:34.666159 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:34.666499 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:38:34.667461 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:34.668816 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:34.669750 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:34.670307 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:34.670499 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:34.673444 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:38:34.673450 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:38:34.673464 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:38:34.673491 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:38:34.675477 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:34.675936 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:34.675949 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:34.675955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:34.676189 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:34.676483 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:34.676488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:34.676489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:34.676993 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:38:34.677274 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:34.677561 (+ 287us) server_negotiation.cc:299] Negotiation successful
0810 01:38:34.677869 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":193,"threads_started":1}
I20260810 01:38:34.678966 10787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31267c49b1b64010af5ff8d3455e21c3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43955 } }
I20260810 01:38:34.679387 10787 leader_election.cc:302] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31267c49b1b64010af5ff8d3455e21c3; no voters:
I20260810 01:38:34.679783 10787 leader_election.cc:288] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:38:34.680018 10796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:38:34.680510 10796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [term 1 LEADER]: Becoming Leader. State: Replica: 31267c49b1b64010af5ff8d3455e21c3, State: Running, Role: LEADER
I20260810 01:38:34.680850 10796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31267c49b1b64010af5ff8d3455e21c3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43955 } }
I20260810 01:38:34.681672 10787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:38:34.683126 10799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31267c49b1b64010af5ff8d3455e21c3. Latest consensus state: current_term: 1 leader_uuid: "31267c49b1b64010af5ff8d3455e21c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31267c49b1b64010af5ff8d3455e21c3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43955 } } }
I20260810 01:38:34.683126 10798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31267c49b1b64010af5ff8d3455e21c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31267c49b1b64010af5ff8d3455e21c3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43955 } } }
I20260810 01:38:34.683393 10798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [sys.catalog]: This master's current role is: LEADER
I20260810 01:38:34.683575 10799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3 [sys.catalog]: This master's current role is: LEADER
I20260810 01:38:34.684963 10806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:38:34.689028 10806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:38:34.689525 10787 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 01:38:34.706192 10806 catalog_manager.cc:1347] Generated new cluster ID: 526a614f7c69413cb8660f67b0fb0ff8
I20260810 01:38:34.706346 10806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:38:34.726683 10806 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:38:34.728145 10806 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:38:34.735750 10806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3: Generated new TSK 0
I20260810 01:38:34.736698 10806 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:38:35.619853 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:41361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43955
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:38:35.785303 10855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:38:35.785588 10855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:38:35.785635 10855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:38:35.790041 10855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:38:35.790104 10855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:38:35.790196 10855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:38:35.796190 10855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.205.148:41361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:38:35.797351 10855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:38:35.798550 10855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:38:35.811182 10868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:38:35.811108 10865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:38:35.811276 10864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:38:35.811539 10855 server_base.cc:1034] running on GCE node
I20260810 01:38:35.812114 10855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:38:35.812754 10855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:38:35.813969 10855 hybrid_clock.cc:648] HybridClock initialized: now 1786325915813945 us; error 42 us; skew 500 ppm
Aug 10 01:38:35 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325915, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:38:35.818861 10855 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:38:35.820226 10855 webserver.cc:460] Webserver started at http://127.24.205.129:36695/ using document root <none> and password file <none>
I20260810 01:38:35.821098 10855 fs_manager.cc:359] Metadata directory not provided
I20260810 01:38:35.821218 10855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:38:35.821573 10855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:38:35 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325915, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:38:35.840950 10855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "fb2bff3f359d49838524ebf1f9a4e771"
format_stamp: "Formatted at 2026-08-10 01:38:35 on dist-test-slave-t3q3"
server_key: "d364b96ce582f176606bb00286e201f6"
server_key_iv: "f348503cca0f59e506ab7a48e9c4db8f"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:35.842185 10855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "fb2bff3f359d49838524ebf1f9a4e771"
format_stamp: "Formatted at 2026-08-10 01:38:35 on dist-test-slave-t3q3"
server_key: "d364b96ce582f176606bb00286e201f6"
server_key_iv: "f348503cca0f59e506ab7a48e9c4db8f"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:35.848489 10855 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260810 01:38:35.867848 10881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:35.870042 10855 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:38:35.870194 10855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "fb2bff3f359d49838524ebf1f9a4e771"
format_stamp: "Formatted at 2026-08-10 01:38:35 on dist-test-slave-t3q3"
server_key: "d364b96ce582f176606bb00286e201f6"
server_key_iv: "f348503cca0f59e506ab7a48e9c4db8f"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:35.870334 10855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:38:35.892431 10855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:38:35.897825 10855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:38:35.898254 10855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:38:35.899405 10855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:38:35.901082 10855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:38:35.901204 10855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:35.901396 10855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:38:35.901520 10855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:35.926815 10855 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:43171
I20260810 01:38:35.927350 11058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:43171 every 8 connection(s)
I20260810 01:38:35.928339 10855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:38:35.931825 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 10855
I20260810 01:38:35.931988 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:38:35.932480 25398 external_mini_cluster.cc:1428] Setting key f94e9346cfa8db5c4a419a28acc82bdc
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Aug 10 01:38:35 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325915, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:38:35.959990 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:35.931380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:54173 (local address 127.24.205.190:43955)
0810 01:38:35.931674 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:35.931679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:35.933605 (+ 1926us) server_negotiation.cc:407] Connection header received
0810 01:38:35.937447 (+ 3842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:35.937454 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:35.937524 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:35.937623 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:38:35.939802 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:35.940786 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:35.942811 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:35.943167 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:35.943278 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:35.953370 (+ 10092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:38:35.953375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:38:35.953379 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:38:35.953416 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:38:35.955539 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:35.956433 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:35.956437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:35.956439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:35.956556 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:35.957095 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:35.957098 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:35.957100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:35.957393 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:38:35.957521 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:35.959691 (+ 2170us) server_negotiation.cc:299] Negotiation successful
0810 01:38:35.959841 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":85,"threads_started":1}
I20260810 01:38:35.960017 11066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:35.931906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43955 (local address 127.24.205.129:54173)
0810 01:38:35.933393 (+ 1487us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:35.933466 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:35.937024 (+ 3558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:35.937886 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:35.937897 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:35.938535 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:38:35.939559 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:35.939592 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:35.940988 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:35.940992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:35.942653 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:35.942666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:35.943478 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:35.943482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:35.943782 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:35.944928 (+ 1146us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:38:35.944952 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:38:35.953078 (+ 8126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:38:35.955722 (+ 2644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:38:35.955731 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:38:35.955753 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:38:35.956276 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:38:35.956673 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:38:35.956677 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:38:35.956679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:38:35.956886 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:38:35.957584 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:38:35.957592 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:38:35.958085 (+ 493us) client_negotiation.cc:769] Sending connection context
0810 01:38:35.958330 (+ 245us) client_negotiation.cc:240] Negotiation successful
0810 01:38:35.958750 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1146,"thread_start_us":186,"threads_started":1}
I20260810 01:38:35.961802 11062 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43955
I20260810 01:38:35.962077 11062 heartbeater.cc:464] Registering TS with master...
I20260810 01:38:35.962695 11062 heartbeater.cc:511] Master 127.24.205.190:43955 requested a full tablet report, sending...
I20260810 01:38:35.964742 10725 ts_manager.cc:194] Registered new tserver with Master: fb2bff3f359d49838524ebf1f9a4e771 (127.24.205.129:43171)
I20260810 01:38:35.966598 10725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:54173
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:38:35.979874 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:41361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43955
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 01:38:36.208568 11070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:38:36.208962 11070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:38:36.209048 11070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:38:36.214716 11070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:38:36.214826 11070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:38:36.214938 11070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:38:36.221812 11070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.205.148:41361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:38:36.223101 11070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:38:36.224294 11070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:38:36.238155 11094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:38:36.238391 11096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:38:36.238756 11099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:38:36.238978 11070 server_base.cc:1034] running on GCE node
I20260810 01:38:36.239564 11070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:38:36.240384 11070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:38:36.241580 11070 hybrid_clock.cc:648] HybridClock initialized: now 1786325916241543 us; error 52 us; skew 500 ppm
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:38:36.245105 11070 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:38:36.246196 11070 webserver.cc:460] Webserver started at http://127.24.205.130:46849/ using document root <none> and password file <none>
I20260810 01:38:36.246816 11070 fs_manager.cc:359] Metadata directory not provided
I20260810 01:38:36.246912 11070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:38:36.247146 11070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:38:36.265376 11070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "bcff6342d96247dc9e76a5673f898355"
format_stamp: "Formatted at 2026-08-10 01:38:36 on dist-test-slave-t3q3"
server_key: "d655bf1835e7b0dcf1d4a3c01221cbb8"
server_key_iv: "476989a5123f1cd68aba1fa9d3caeb25"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:36.266412 11070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "bcff6342d96247dc9e76a5673f898355"
format_stamp: "Formatted at 2026-08-10 01:38:36 on dist-test-slave-t3q3"
server_key: "d655bf1835e7b0dcf1d4a3c01221cbb8"
server_key_iv: "476989a5123f1cd68aba1fa9d3caeb25"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:36.274261 11070 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260810 01:38:36.297134 11111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:36.299314 11070 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:38:36.299474 11070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "bcff6342d96247dc9e76a5673f898355"
format_stamp: "Formatted at 2026-08-10 01:38:36 on dist-test-slave-t3q3"
server_key: "d655bf1835e7b0dcf1d4a3c01221cbb8"
server_key_iv: "476989a5123f1cd68aba1fa9d3caeb25"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:36.299734 11070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:38:36.333539 11070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:38:36.337790 11070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:38:36.338091 11070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:38:36.339167 11070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:38:36.340715 11070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:38:36.340873 11070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 01:38:36.340986 11070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:38:36.341055 11070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:36.365228 11070 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:35869
I20260810 01:38:36.365307 11310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:35869 every 8 connection(s)
I20260810 01:38:36.366910 11070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:38:36.367795 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 11070
I20260810 01:38:36.367928 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:38:36.368294 25398 external_mini_cluster.cc:1428] Setting key fc7f95321fcd9af6dbfe89ea380be192
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:38:36.390698 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.370462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:38691 (local address 127.24.205.190:43955)
0810 01:38:36.370587 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:36.370592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:36.372029 (+ 1437us) server_negotiation.cc:407] Connection header received
0810 01:38:36.374071 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:36.374075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:36.374129 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:36.374185 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:38:36.376480 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.377599 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.380402 (+ 2803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.380830 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.380915 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.386127 (+ 5212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:38:36.386132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:38:36.386135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:38:36.386164 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:38:36.388056 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:36.388771 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:36.388775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:36.388778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:36.388869 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:36.389305 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:36.389308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:36.389310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:36.389543 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:38:36.389628 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:36.390348 (+ 720us) server_negotiation.cc:299] Negotiation successful
0810 01:38:36.390496 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:38:36.392508 11313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.371043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43955 (local address 127.24.205.130:38691)
0810 01:38:36.371847 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:36.371918 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:36.373731 (+ 1813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:36.374707 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:36.374717 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:36.375294 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:38:36.376286 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.376309 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.377901 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.377904 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.380165 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.380189 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.381151 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.381155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.381484 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.382297 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:38:36.382319 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:38:36.385872 (+ 3553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:38:36.388246 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:38:36.388253 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:38:36.388271 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:38:36.388642 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:38:36.388994 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:38:36.388997 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:38:36.388999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:38:36.389186 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:38:36.389698 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:38:36.389706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:38:36.390054 (+ 348us) client_negotiation.cc:769] Sending connection context
0810 01:38:36.390889 (+ 835us) client_negotiation.cc:240] Negotiation successful
0810 01:38:36.391267 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":230,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:38:36.394589 11311 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43955
I20260810 01:38:36.394948 11311 heartbeater.cc:464] Registering TS with master...
I20260810 01:38:36.395692 11311 heartbeater.cc:511] Master 127.24.205.190:43955 requested a full tablet report, sending...
I20260810 01:38:36.397145 10725 ts_manager.cc:194] Registered new tserver with Master: bcff6342d96247dc9e76a5673f898355 (127.24.205.130:35869)
I20260810 01:38:36.398121 10725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:38691
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:38:36.419106 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:41361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43955
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:38:36.638218 11318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:38:36.638636 11318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:38:36.638715 11318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:38:36.645191 11318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:38:36.645299 11318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:38:36.645401 11318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:38:36.654810 11318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.205.148:41361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:38:36.656363 11318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:38:36.657868 11318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:38:36.677251 11330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:38:36.678853 11334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:38:36.679111 11318 server_base.cc:1034] running on GCE node
W20260810 01:38:36.679246 11329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:38:36.679948 11318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:38:36.680868 11318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:38:36.682044 11318 hybrid_clock.cc:648] HybridClock initialized: now 1786325916682007 us; error 59 us; skew 500 ppm
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:38:36.686815 11318 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:38:36.688107 11318 webserver.cc:460] Webserver started at http://127.24.205.131:44989/ using document root <none> and password file <none>
I20260810 01:38:36.688886 11318 fs_manager.cc:359] Metadata directory not provided
I20260810 01:38:36.689018 11318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:38:36.689298 11318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:38:36.715926 11318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "b43bcbc9ebec409f8b09958ee3c507f4"
format_stamp: "Formatted at 2026-08-10 01:38:36 on dist-test-slave-t3q3"
server_key: "fb0de48f8e5f15dc96f1df93d3cb915f"
server_key_iv: "6ecc9ba80c0f072297595a479c159b44"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:36.718559 11318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "b43bcbc9ebec409f8b09958ee3c507f4"
format_stamp: "Formatted at 2026-08-10 01:38:36 on dist-test-slave-t3q3"
server_key: "fb0de48f8e5f15dc96f1df93d3cb915f"
server_key_iv: "6ecc9ba80c0f072297595a479c159b44"
server_key_version: "kuduclusterkey@0"
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:38:36.757230 11318 fs_manager.cc:691] Time spent creating directory manager: real 0.038s user 0.004s sys 0.000s
I20260810 01:38:36.794795 11347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:36.796648 11318 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260810 01:38:36.796779 11318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "b43bcbc9ebec409f8b09958ee3c507f4"
format_stamp: "Formatted at 2026-08-10 01:38:36 on dist-test-slave-t3q3"
server_key: "fb0de48f8e5f15dc96f1df93d3cb915f"
server_key_iv: "6ecc9ba80c0f072297595a479c159b44"
server_key_version: "kuduclusterkey@0"
I20260810 01:38:36.796914 11318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:38:36.825270 11318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:38:36.829559 11318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:38:36.829854 11318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:38:36.830852 11318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:38:36.832428 11318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:38:36.832568 11318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:36.832785 11318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:38:36.832886 11318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:38:36.863899 11318 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:39805
I20260810 01:38:36.864604 11520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:39805 every 8 connection(s)
I20260810 01:38:36.865393 11318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:38:36.871574 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 11318
I20260810 01:38:36.871734 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:38:36.872051 25398 external_mini_cluster.cc:1428] Setting key d127cea5a4753ff6bcdbf5b9f9e1bb75
Aug 10 01:38:36 dist-test-slave-t3q3 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325916, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:38:36.885936 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.870700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:49071 (local address 127.24.205.190:43955)
0810 01:38:36.870849 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:36.870854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:36.870876 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:38:36.872295 (+ 1419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:36.872301 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:36.872362 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:36.872418 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:38:36.874623 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.875512 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.877475 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.877844 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.877964 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.881393 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:38:36.881396 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:38:36.881399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:38:36.881426 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:38:36.883278 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:36.883927 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:36.883931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:36.883933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:36.884085 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:36.884508 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:36.884511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:36.884513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:36.884774 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:38:36.884906 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:36.885597 (+ 691us) server_negotiation.cc:299] Negotiation successful
0810 01:38:36.885765 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:38:36.887959 11523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.869415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43955 (local address 127.24.205.131:49071)
0810 01:38:36.870521 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:36.870586 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:36.871967 (+ 1381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:36.872909 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:36.872919 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:36.873532 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:38:36.874406 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.874427 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.875655 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.875659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.877321 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.877334 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.878021 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.878025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.878327 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.879171 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:38:36.879193 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:38:36.881182 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:38:36.883409 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:38:36.883416 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:38:36.883434 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:38:36.883802 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:38:36.884190 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:38:36.884193 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:38:36.884195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:38:36.884386 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:38:36.884906 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:38:36.884913 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:38:36.885271 (+ 358us) client_negotiation.cc:769] Sending connection context
0810 01:38:36.886381 (+ 1110us) client_negotiation.cc:240] Negotiation successful
0810 01:38:36.886783 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":223,"threads_started":1}
I20260810 01:38:36.889317 11521 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43955
I20260810 01:38:36.889586 11521 heartbeater.cc:464] Registering TS with master...
I20260810 01:38:36.890251 11521 heartbeater.cc:511] Master 127.24.205.190:43955 requested a full tablet report, sending...
I20260810 01:38:36.891443 10725 ts_manager.cc:194] Registered new tserver with Master: b43bcbc9ebec409f8b09958ee3c507f4 (127.24.205.131:39805)
I20260810 01:38:36.892241 10725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:49071
I20260810 01:38:36.899006 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:38:36.911561 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.901593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59368 (local address 127.24.205.190:43955)
0810 01:38:36.901729 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:36.901734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:36.902060 (+ 326us) server_negotiation.cc:407] Connection header received
0810 01:38:36.902211 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:36.902215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:36.902273 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:36.902372 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:38:36.903426 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.904342 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.905395 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.905755 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.905889 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.907631 (+ 1742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:38:36.907636 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:38:36.907639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:38:36.907673 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:38:36.909651 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:36.910087 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:36.910091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:36.910093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:36.910210 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:38:36.910561 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:38:36.910565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:38:36.910567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:38:36.910842 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:38:36.910994 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:36.911229 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 01:38:36.911369 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:38:36.915189 10725 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:38:36.918561 10725 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:38:36.938861 11538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.930097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36432 (local address 127.24.205.129:43171)
0810 01:38:36.931429 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:36.931447 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:36.932808 (+ 1361us) server_negotiation.cc:407] Connection header received
0810 01:38:36.933216 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:36.933223 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:36.933444 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:36.933542 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:38:36.933948 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.934902 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.936742 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.937660 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.937761 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.938100 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:36.938571 (+ 471us) server_negotiation.cc:299] Negotiation successful
0810 01:38:36.938713 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":150,"threads_started":1}
I20260810 01:38:36.939641 11546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.930126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43171 (local address 127.0.0.1:36432)
0810 01:38:36.932704 (+ 2578us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:36.932722 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:36.932952 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:36.933704 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:36.933709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:36.933728 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:38:36.933829 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.933833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.935255 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.935258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.936601 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.936621 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.938223 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.938227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.938340 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.938381 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 01:38:36.939151 (+ 770us) client_negotiation.cc:240] Negotiation successful
0810 01:38:36.939474 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2500,"mutex_wait_us":164,"spinlock_wait_cycles":37504,"thread_start_us":1539,"threads_started":1}
I20260810 01:38:36.944243 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.930872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36938 (local address 127.24.205.130:35869)
0810 01:38:36.933585 (+ 2713us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:36.933592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:36.933645 (+ 53us) server_negotiation.cc:407] Connection header received
0810 01:38:36.933773 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:36.933779 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:36.934136 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:36.934391 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:38:36.935199 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.937346 (+ 2147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.941103 (+ 3757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.942782 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.943018 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.943295 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:36.943913 (+ 618us) server_negotiation.cc:299] Negotiation successful
0810 01:38:36.944026 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2458,"thread_start_us":86,"threads_started":1}
I20260810 01:38:36.944351 11540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.930120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:35869 (local address 127.0.0.1:36938)
0810 01:38:36.932612 (+ 2492us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:36.932711 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:36.932956 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:36.934701 (+ 1745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:36.934704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:36.934741 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:38:36.934954 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.934970 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.937627 (+ 2657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.937640 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.940839 (+ 3199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.940867 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.943427 (+ 2560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.943439 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.943680 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.943736 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 01:38:36.943878 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 01:38:36.944042 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2117,"spinlock_wait_cycles":4224,"thread_start_us":200,"threads_started":1}
I20260810 01:38:36.943580 10955 tablet_service.cc:1467] Processing CreateTablet for tablet 135ac96137fa4506873cf715c2f48600 (DEFAULT_TABLE table=test-table [id=7c3808483c9b4433b4ce111d166dd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:38:36.947798 11547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.930593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:39805 (local address 127.0.0.1:41072)
0810 01:38:36.936273 (+ 5680us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:36.936289 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:36.936389 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:36.937074 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:36.937077 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:36.937093 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:38:36.937183 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.937189 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.939698 (+ 2509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.939702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.940920 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:36.940931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.947329 (+ 6398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.947333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:36.947438 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.947465 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:38:36.947572 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 01:38:36.947657 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5614,"thread_start_us":649,"threads_started":1}
I20260810 01:38:36.948246 11542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:36.931206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41072 (local address 127.24.205.131:39805)
0810 01:38:36.933211 (+ 2005us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:36.933253 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:36.936483 (+ 3230us) server_negotiation.cc:407] Connection header received
0810 01:38:36.936568 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:36.936574 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:36.936787 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:36.936931 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:38:36.937315 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.939557 (+ 2242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.945334 (+ 5777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:36.947119 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:36.947374 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:36.947643 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:36.947738 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 01:38:36.947918 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1892,"thread_start_us":175,"threads_started":1}
I20260810 01:38:36.948038 11201 tablet_service.cc:1467] Processing CreateTablet for tablet 135ac96137fa4506873cf715c2f48600 (DEFAULT_TABLE table=test-table [id=7c3808483c9b4433b4ce111d166dd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:38:36.950909 11403 tablet_service.cc:1467] Processing CreateTablet for tablet 135ac96137fa4506873cf715c2f48600 (DEFAULT_TABLE table=test-table [id=7c3808483c9b4433b4ce111d166dd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:38:36.951867 11403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 135ac96137fa4506873cf715c2f48600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:38:36.952185 11201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 135ac96137fa4506873cf715c2f48600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:38:36.958220 10955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 135ac96137fa4506873cf715c2f48600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:38:36.969300 11548 tablet_bootstrap.cc:492] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Bootstrap starting.
I20260810 01:38:36.970211 11062 heartbeater.cc:503] Master 127.24.205.190:43955 was elected leader, sending a full tablet report...
I20260810 01:38:36.973393 11548 tablet_bootstrap.cc:654] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Neither blocks nor log segments found. Creating new log.
I20260810 01:38:36.975654 11548 log.cc:824] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Log is configured to *not* fsync() on all Append() calls
I20260810 01:38:36.976441 11549 tablet_bootstrap.cc:492] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771: Bootstrap starting.
I20260810 01:38:36.978267 11552 tablet_bootstrap.cc:492] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: Bootstrap starting.
I20260810 01:38:36.978578 11548 tablet_bootstrap.cc:492] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: No bootstrap required, opened a new log
I20260810 01:38:36.978798 11548 ts_tablet_manager.cc:1397] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260810 01:38:36.985199 11548 raft_consensus.cc:348] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:36.985688 11548 raft_consensus.cc:374] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:38:36.985790 11548 raft_consensus.cc:729] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43bcbc9ebec409f8b09958ee3c507f4, State: Initialized, Role: FOLLOWER
I20260810 01:38:36.986340 11549 tablet_bootstrap.cc:654] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771: Neither blocks nor log segments found. Creating new log.
I20260810 01:38:36.986425 11548 consensus_queue.cc:260] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:36.987095 11552 tablet_bootstrap.cc:654] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: Neither blocks nor log segments found. Creating new log.
I20260810 01:38:36.987800 11548 ts_tablet_manager.cc:1428] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260810 01:38:36.988324 11521 heartbeater.cc:503] Master 127.24.205.190:43955 was elected leader, sending a full tablet report...
I20260810 01:38:36.989141 11549 log.cc:824] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771: Log is configured to *not* fsync() on all Append() calls
I20260810 01:38:36.992450 11552 log.cc:824] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: Log is configured to *not* fsync() on all Append() calls
I20260810 01:38:36.995182 11549 tablet_bootstrap.cc:492] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771: No bootstrap required, opened a new log
I20260810 01:38:36.995512 11549 ts_tablet_manager.cc:1397] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.000s
I20260810 01:38:36.996716 11552 tablet_bootstrap.cc:492] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: No bootstrap required, opened a new log
I20260810 01:38:36.997058 11552 ts_tablet_manager.cc:1397] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20260810 01:38:37.003309 11549 raft_consensus.cc:348] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:37.003788 11549 raft_consensus.cc:374] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:38:37.003901 11549 raft_consensus.cc:729] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2bff3f359d49838524ebf1f9a4e771, State: Initialized, Role: FOLLOWER
I20260810 01:38:37.004669 11549 consensus_queue.cc:260] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:37.007328 11549 ts_tablet_manager.cc:1428] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260810 01:38:37.007105 11552 raft_consensus.cc:348] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:37.007539 11552 raft_consensus.cc:374] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:38:37.008172 11552 raft_consensus.cc:729] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcff6342d96247dc9e76a5673f898355, State: Initialized, Role: FOLLOWER
I20260810 01:38:37.008749 11552 consensus_queue.cc:260] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:37.010015 11552 ts_tablet_manager.cc:1428] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: Time spent starting tablet: real 0.013s user 0.009s sys 0.000s
I20260810 01:38:37.010450 11311 heartbeater.cc:503] Master 127.24.205.190:43955 was elected leader, sending a full tablet report...
I20260810 01:38:37.030087 11561 raft_consensus.cc:482] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:38:37.030356 11561 raft_consensus.cc:504] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:37.031828 11561 leader_election.cc:288] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b43bcbc9ebec409f8b09958ee3c507f4 (127.24.205.131:39805), bcff6342d96247dc9e76a5673f898355 (127.24.205.130:35869)
I20260810 01:38:37.038900 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.032566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:60239 (local address 127.24.205.130:35869)
0810 01:38:37.032720 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:37.032724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:37.033609 (+ 885us) server_negotiation.cc:407] Connection header received
0810 01:38:37.033895 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:37.033899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:37.033948 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:37.033994 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:38:37.034602 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.035366 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.037331 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.038057 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.038155 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:37.038210 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:37.038667 (+ 457us) server_negotiation.cc:299] Negotiation successful
0810 01:38:37.038758 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:38:37.039651 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.032311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:35869 (local address 127.24.205.129:60239)
0810 01:38:37.033117 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:37.033132 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:37.033758 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:37.034145 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:37.034148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:37.034165 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:38:37.034465 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:37.034471 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.035509 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.035512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:37.037181 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:37.037194 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.038310 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.038314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:37.038513 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:37.038538 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:38:37.039308 (+ 770us) client_negotiation.cc:240] Negotiation successful
0810 01:38:37.039393 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":203,"threads_started":1}
I20260810 01:38:37.039659 11542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.032860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:33049 (local address 127.24.205.131:39805)
0810 01:38:37.033034 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:37.033090 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:37.033492 (+ 402us) server_negotiation.cc:407] Connection header received
0810 01:38:37.034413 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:37.034417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:37.034489 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:37.034551 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:38:37.035541 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.036334 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.038181 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.038812 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.038923 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:37.038972 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:37.039441 (+ 469us) server_negotiation.cc:299] Negotiation successful
0810 01:38:37.039531 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:38:37.040241 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.032223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:39805 (local address 127.24.205.129:33049)
0810 01:38:37.033146 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:37.033163 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:38:37.033588 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:38:37.035048 (+ 1460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:38:37.035051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:38:37.035071 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:38:37.035365 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:37.035376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.036593 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.036598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:37.037987 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:38:37.038008 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.039090 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.039093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:38:37.039277 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:37.039302 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:38:37.039908 (+ 606us) client_negotiation.cc:240] Negotiation successful
0810 01:38:37.040006 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"mutex_wait_us":18,"thread_start_us":240,"threads_started":1}
I20260810 01:38:37.041016 11227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135ac96137fa4506873cf715c2f48600" candidate_uuid: "fb2bff3f359d49838524ebf1f9a4e771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff6342d96247dc9e76a5673f898355" is_pre_election: true
I20260810 01:38:37.041324 11456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135ac96137fa4506873cf715c2f48600" candidate_uuid: "fb2bff3f359d49838524ebf1f9a4e771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" is_pre_election: true
I20260810 01:38:37.041395 11227 raft_consensus.cc:2454] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb2bff3f359d49838524ebf1f9a4e771 in term 0.
I20260810 01:38:37.041647 11456 raft_consensus.cc:2454] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb2bff3f359d49838524ebf1f9a4e771 in term 0.
I20260810 01:38:37.042133 10885 leader_election.cc:302] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcff6342d96247dc9e76a5673f898355, fb2bff3f359d49838524ebf1f9a4e771; no voters:
I20260810 01:38:37.042637 11561 raft_consensus.cc:2781] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:38:37.042719 11561 raft_consensus.cc:482] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:38:37.042758 11561 raft_consensus.cc:3037] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:38:37.044669 11561 raft_consensus.cc:504] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:37.045235 11561 leader_election.cc:288] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [CANDIDATE]: Term 1 election: Requested vote from peers b43bcbc9ebec409f8b09958ee3c507f4 (127.24.205.131:39805), bcff6342d96247dc9e76a5673f898355 (127.24.205.130:35869)
I20260810 01:38:37.046048 11227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135ac96137fa4506873cf715c2f48600" candidate_uuid: "fb2bff3f359d49838524ebf1f9a4e771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff6342d96247dc9e76a5673f898355"
I20260810 01:38:37.046204 11227 raft_consensus.cc:3037] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:38:37.048172 11227 raft_consensus.cc:2454] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb2bff3f359d49838524ebf1f9a4e771 in term 1.
I20260810 01:38:37.048640 10885 leader_election.cc:302] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcff6342d96247dc9e76a5673f898355, fb2bff3f359d49838524ebf1f9a4e771; no voters:
I20260810 01:38:37.048875 11561 raft_consensus.cc:2781] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:38:37.049249 11561 raft_consensus.cc:686] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [term 1 LEADER]: Becoming Leader. State: Replica: fb2bff3f359d49838524ebf1f9a4e771, State: Running, Role: LEADER
I20260810 01:38:37.049625 11561 consensus_queue.cc:237] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } }
I20260810 01:38:37.051128 11456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135ac96137fa4506873cf715c2f48600" candidate_uuid: "fb2bff3f359d49838524ebf1f9a4e771" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43bcbc9ebec409f8b09958ee3c507f4"
I20260810 01:38:37.051292 11456 raft_consensus.cc:3037] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:38:37.053378 11456 raft_consensus.cc:2454] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb2bff3f359d49838524ebf1f9a4e771 in term 1.
I20260810 01:38:37.053344 10725 catalog_manager.cc:5495] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb2bff3f359d49838524ebf1f9a4e771 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "fb2bff3f359d49838524ebf1f9a4e771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2bff3f359d49838524ebf1f9a4e771" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 } health_report { overall_health: UNKNOWN } } }
I20260810 01:38:37.070910 11538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.065262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36444 (local address 127.24.205.129:43171)
0810 01:38:37.065399 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:38:37.065404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:38:37.065819 (+ 415us) server_negotiation.cc:407] Connection header received
0810 01:38:37.065913 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:38:37.065916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:38:37.065992 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:38:37.066109 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:38:37.066550 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.067408 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.068747 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:38:37.069115 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:38:37.069244 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:38:37.069643 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:38:37.070303 (+ 660us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:38:37.070443 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 01:38:37.070555 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 01:38:37.070625 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:38:37.081231 11227 raft_consensus.cc:1261] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 1 FOLLOWER]: Refusing update from remote peer fb2bff3f359d49838524ebf1f9a4e771: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:38:37.081503 11456 raft_consensus.cc:1261] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 1 FOLLOWER]: Refusing update from remote peer fb2bff3f359d49838524ebf1f9a4e771: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:38:37.082261 11561 consensus_queue.cc:1035] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcff6342d96247dc9e76a5673f898355" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:38:37.082556 11569 consensus_queue.cc:1035] T 135ac96137fa4506873cf715c2f48600 P fb2bff3f359d49838524ebf1f9a4e771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b43bcbc9ebec409f8b09958ee3c507f4" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 39805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:38:37.097977 11572 mvcc.cc:205] Tried to move back new op lower bound from 7316790956353818624 to 7316790956239142912. Current Snapshot: MvccSnapshot[applied={T|T < 7316790956353818624}]
I20260810 01:38:37.098573 11577 mvcc.cc:205] Tried to move back new op lower bound from 7316790956353818624 to 7316790956239142912. Current Snapshot: MvccSnapshot[applied={T|T < 7316790956353818624}]
I20260810 01:38:37.105144 11575 mvcc.cc:205] Tried to move back new op lower bound from 7316790956353818624 to 7316790956239142912. Current Snapshot: MvccSnapshot[applied={T|T < 7316790956353818624}]
I20260810 01:38:37.112748 10722 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:38:37.112946 10722 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:38:37.116113 10722 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 31267c49b1b64010af5ff8d3455e21c3: Sending DeleteTablet for 3 replicas of tablet 135ac96137fa4506873cf715c2f48600
I20260810 01:38:37.117343 10955 tablet_service.cc:1514] Processing DeleteTablet for tablet 135ac96137fa4506873cf715c2f48600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:38:37 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:36432
I20260810 01:38:37.118775 11403 tablet_service.cc:1514] Processing DeleteTablet for tablet 135ac96137fa4506873cf715c2f48600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:38:37 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:41072
I20260810 01:38:37.119623 11201 tablet_service.cc:1514] Processing DeleteTablet for tablet 135ac96137fa4506873cf715c2f48600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:38:37 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:36938
I20260810 01:38:37.119863 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 10855
I20260810 01:38:37.137739 11595 tablet_replica.cc:330] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: stopping tablet replica
I20260810 01:38:37.138264 11595 raft_consensus.cc:2229] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:38:37.138762 11595 raft_consensus.cc:2258] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:38:37.140826 11595 ts_tablet_manager.cc:1905] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:38:37.143994 11596 tablet_replica.cc:330] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: stopping tablet replica
I20260810 01:38:37.144438 11596 raft_consensus.cc:2229] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:38:37.144681 11595 ts_tablet_manager.cc:1918] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:38:37.144866 11595 log.cc:1196] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/135ac96137fa4506873cf715c2f48600
I20260810 01:38:37.144886 11596 raft_consensus.cc:2258] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:38:37.145489 11595 ts_tablet_manager.cc:1939] T 135ac96137fa4506873cf715c2f48600 P b43bcbc9ebec409f8b09958ee3c507f4: Deleting consensus metadata
W20260810 01:38:37.145829 10697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:43171 (error 108)
I20260810 01:38:37.147456 10700 catalog_manager.cc:4841] TS b43bcbc9ebec409f8b09958ee3c507f4 (127.24.205.131:39805): tablet 135ac96137fa4506873cf715c2f48600 (table test-table [id=7c3808483c9b4433b4ce111d166dd435]) successfully deleted
I20260810 01:38:37.147704 11596 ts_tablet_manager.cc:1905] T 135ac96137fa4506873cf715c2f48600 P bcff6342d96247dc9e76a5673f898355: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:38:37.149051 11547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.148702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43171 (local address 127.0.0.1:36452)
0810 01:38:37.148888 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:37.148959 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260810 01:38:37.149348 10697 catalog_manager.cc:4584] TS fb2bff3f359d49838524ebf1f9a4e771 (127.24.205.129:43171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 135ac96137fa4506873cf715c2f48600: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43171: connect: Connection refused (error 111)
I20260810 01:38:37.149802 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 11070
I20260810 01:38:37.182904 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 11318
I20260810 01:38:37.199151 11547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.198794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:35869 (local address 127.0.0.1:36942)
0810 01:38:37.198944 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:37.199017 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.130:35869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 01:38:37.202514 11547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.202137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43171 (local address 127.0.0.1:36454)
0810 01:38:37.202339 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:37.202404 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260810 01:38:37.203770 11547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:38:37.203233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43171 (local address 127.0.0.1:36468)
0810 01:38:37.203520 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 01:38:37.203624 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260810 01:38:37.209479 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 10672
I20260810 01:38:37.226285 25398 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 01:38:37.571537 25398 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 01:38:37.571725 25398 mini_ranger.cc:66] Stopping Ranger...
I20260810 01:38:37.917176 25398 mini_ranger.cc:68] Stopped Ranger
2026-08-10 01:38:37.917 UTC [9947] LOG: received smart shutdown request
2026-08-10 01:38:37.921 UTC [9947] LOG: background worker "logical replication launcher" (PID 9957) exited with exit code 1
2026-08-10 01:38:37.921 UTC [9952] LOG: shutting down
2026-08-10 01:38:38.094 UTC [9947] LOG: database system is shut down
2026-08-10T01:38:38Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50420 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:38:38 dist-test-slave-t3q3 krb5kdc[11614](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:38:38 dist-test-slave-t3q3 krb5kdc[11614](info): set up 2 sockets
Aug 10 01:38:38 dist-test-slave-t3q3 krb5kdc[11614](info): commencing operation
krb5kdc: starting...
W20260810 01:38:39.558177 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:38:39 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:38:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:38:39Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/rangeradmin_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/rangeradmin_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/rangerlookup_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/rangerlookup_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
I20260810 01:38:39.742408 25398 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskdl8Mys/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/postgres -l logfile start
2026-08-10 01:38:42.226 UTC [11656] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 01:38:42.226 UTC [11656] LOG: listening on IPv4 address "127.24.205.148", port 41707
2026-08-10 01:38:42.229 UTC [11656] LOG: listening on Unix socket "/tmp/.s.PGSQL.41707"
2026-08-10 01:38:42.250 UTC [11661] LOG: database system was shut down at 2026-08-10 01:38:40 UTC
2026-08-10 01:38:42.253 UTC [11656] LOG: database system is ready to accept connections
I20260810 01:38:43.443737 25398 mini_postgres.cc:96] Postgres bound to 41707
2026-08-10 01:38:43.452 UTC [11673] FATAL: database "slave" does not exist
127.24.205.148:41707 - accepting connections
I20260810 01:38:43.452800 25398 mini_ranger.cc:161] Starting Ranger...
I20260810 01:38:43.468732 25398 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 01:38:43.952560 25398 mini_ranger.cc:87] Created ranger Postgres database
I20260810 01:38:43.952633 25398 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-admin
2026-08-10 01:38:44,231 [I] DB FLAVOR :POSTGRES
2026-08-10 01:38:44,232 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:38:44,232 [I] Checking connection..
2026-08-10 01:38:44,232 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 01:38:44,495 [I] Checking connection passed.
2026-08-10 01:38:44,495 [I] --------- Verifying version history table ---------
2026-08-10 01:38:44,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:38:44,759 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:38:44,760 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:38:45,015 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:38:45,015 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 01:38:45,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 01:38:45.264 UTC [11774] WARNING: there is no transaction in progress
2026-08-10 01:38:45,274 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 01:38:45,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:38:45,549 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 01:38:45,549 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:38:45,550 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 01:38:45,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 01:38:46,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t3q3.c.gcp-upstream.internal','N') ;"
2026-08-10 01:38:46,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:38:46,555 [I] Table x_portal_user does not exist in database ranger
2026-08-10 01:38:46,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:38:46,815 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 01:38:46,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:38:47,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:38:47,305 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 01:38:47,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 01:38:48.272 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.286 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.303 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.318 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.335 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.354 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.410 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.417 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.432 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.443 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.453 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.466 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.475 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.481 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.488 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:48.495 UTC [11970] WARNING: there is no transaction in progress
2026-08-10 01:38:49,148 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 01:38:49,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 01:38:49,414 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 01:38:49,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:38:49,673 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 01:38:49,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:38:49,933 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 01:38:49,933 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:38:50,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:38:50,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t3q3.c.gcp-upstream.internal';"
2026-08-10 01:38:50,702 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 01:38:50,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 01:38:50,960 [I] DB_PATCHES have already been applied
I20260810 01:38:50.966584 25398 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-admin:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskdl8Mys/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 01:38:50.966656 25398 mini_ranger.cc:193] Using host: 127.24.205.148
I20260810 01:38:50.971163 25398 mini_ranger.cc:227] Ranger admin URL: http://127.24.205.148:46187
Aug 10, 2026 1:38:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:38:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:38:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 1:38:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 1:38:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 1:38:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 1:38:51 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 01:38:52.368145 25398 mini_ranger.cc:160] Time spent starting Ranger: real 8.915s user 0.003s sys 0.010s
Aug 10, 2026 1:39:13 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 1:39:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 10, 2026 1:39:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 1:39:14 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 1:39:15 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 01:39:15.559222 25398 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.205.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.205.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/rangerkms_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.205.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/rangerkms_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.205.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.205.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.205.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/HTTP_127.24.205.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 01:39:15 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325955, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 01:39:15.657375 25398 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 01:39:15.669237 25398 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 01:39:16.510928 25398 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 01:39:16.511000 25398 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms
I20260810 01:39:16.511026 25398 mini_ranger_kms.cc:227] Using postgres at 127.24.205.148:41707
2026-08-10 01:39:16,692 [I] DB FLAVOR :POSTGRES
2026-08-10 01:39:16,693 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:39:16,693 [I] Checking connection
2026-08-10 01:39:16,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 01:39:16,964 [I] connection success
2026-08-10 01:39:16,964 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 01:39:16,964 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 01:39:16,964 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 01:39:17,226 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 01:39:17,226 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:39:17,226 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 01:39:17,227 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.205.148:41707/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 01:39:17,527 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 01:39:18.037709 25398 mini_ranger_kms.cc:310] Created kms service
I20260810 01:39:18.243364 25398 mini_ranger_kms.cc:326] Created kudu user
I20260810 01:39:18.288813 25398 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 01:39:18 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325955, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:18.710563 25398 mini_ranger_kms.cc:384] Added ranger policy
I20260810 01:39:18.710741 25398 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms:/tmp/dist-test-taskdl8Mys/build/debug/bin/postgresql.jar:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskdl8Mys/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 01:39:18.710765 25398 mini_ranger_kms.cc:240] Using host: 127.24.205.148
I20260810 01:39:18.715590 25398 mini_ranger_kms.cc:276] Ranger KMS PID: 12263
I20260810 01:39:18.715682 25398 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.205.148:57927
Aug 10, 2026 1:39:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:39:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:39:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 1:39:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 1:39:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 1:39:20 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 01:39:21 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786325961, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.205.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:21.549242 25398 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.892s user 0.004s sys 0.163s
I20260810 01:39:21.549389 25398 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 01:39:21.549471 25398 mini_ranger_kms.cc:401] 127.24.205.148:57927/kms/v1/keys
Aug 10 01:39:21 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325961, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.205.148@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
Aug 10 01:39:22 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325961, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.205.148@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
Aug 10 01:39:24 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325964, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:39:24.355449 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:39599
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:39599
--ranger_config_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:24.475111 12351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:24.475456 12351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:24.475534 12351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:24.479709 12351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:24.479825 12351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:24.479866 12351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:24.479905 12351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:24.479943 12351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:24.485620 12351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.205.148:57927/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:39599
--ranger_config_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:39599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:24.486760 12351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:24.487829 12351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:24.497289 12362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:24.497280 12360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:24.497332 12351 server_base.cc:1034] running on GCE node
W20260810 01:39:24.497280 12364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:24.498211 12351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:24.499414 12351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:24.500638 12351 hybrid_clock.cc:648] HybridClock initialized: now 1786325964500607 us; error 43 us; skew 500 ppm
Aug 10 01:39:24 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325964, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:24.503582 12351 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:24.504590 12351 webserver.cc:460] Webserver started at http://127.24.205.190:39815/ using document root <none> and password file <none>
I20260810 01:39:24.505175 12351 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:24.505260 12351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:24.505503 12351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:39:24 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325964, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:24.562186 12351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "17084460bdfa4b45a8ee0dd7d3e11d93"
format_stamp: "Formatted at 2026-08-10 01:39:24 on dist-test-slave-t3q3"
server_key: "e53d7603fc6e8e7288fea4526edafa61"
server_key_iv: "839cd92bdf294c0f6018f7c7e8b902cc"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:24.563022 12351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "17084460bdfa4b45a8ee0dd7d3e11d93"
format_stamp: "Formatted at 2026-08-10 01:39:24 on dist-test-slave-t3q3"
server_key: "e53d7603fc6e8e7288fea4526edafa61"
server_key_iv: "839cd92bdf294c0f6018f7c7e8b902cc"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:24.568352 12351 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260810 01:39:24.587180 12375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:24.588951 12351 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:24.589128 12351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "17084460bdfa4b45a8ee0dd7d3e11d93"
format_stamp: "Formatted at 2026-08-10 01:39:24 on dist-test-slave-t3q3"
server_key: "e53d7603fc6e8e7288fea4526edafa61"
server_key_iv: "839cd92bdf294c0f6018f7c7e8b902cc"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:24.589280 12351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:24.618084 12351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:24.622116 12351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:24.622349 12351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:24.631595 12468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:39599 every 8 connection(s)
I20260810 01:39:24.631596 12351 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:39599
I20260810 01:39:24.633092 12351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:24.634877 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 12351
I20260810 01:39:24.634999 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:39:24.635340 25398 external_mini_cluster.cc:1428] Setting key cf175c29d644a458a2d48e7844f0d04b
I20260810 01:39:24.636428 12470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:24.642541 12470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Bootstrap starting.
I20260810 01:39:24.645301 12470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:24.646337 12470 log.cc:824] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:24.648722 12470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: No bootstrap required, opened a new log
Aug 10 01:39:24 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325964, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:24.653285 12470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:24.653795 12470 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:24.653887 12470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17084460bdfa4b45a8ee0dd7d3e11d93, State: Initialized, Role: FOLLOWER
I20260810 01:39:24.654425 12470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:24.654590 12470 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:39:24.654597 12477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:24.636902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34586 (local address 127.24.205.190:39599)
0810 01:39:24.640347 (+ 3445us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:24.640368 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:24.640746 (+ 378us) server_negotiation.cc:407] Connection header received
0810 01:39:24.641630 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:24.641655 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:24.642070 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:24.642454 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:24.643386 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:24.644932 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:24.646250 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:24.646962 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:24.647195 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:24.649925 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:24.649930 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:24.649944 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:24.649972 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:24.651645 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:24.652153 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:24.652165 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:24.652170 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:24.652276 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:24.652579 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:24.652582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:24.652584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:24.652987 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:24.653227 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:24.653468 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 01:39:24.653742 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3280,"thread_start_us":149,"threads_started":1}
I20260810 01:39:24.654703 12470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:39:24.654799 12470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:24.655936 12470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:24.656342 12470 leader_election.cc:302] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17084460bdfa4b45a8ee0dd7d3e11d93; no voters:
I20260810 01:39:24.656682 12470 leader_election.cc:288] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:39:24.657105 12488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:24.657337 12488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 LEADER]: Becoming Leader. State: Replica: 17084460bdfa4b45a8ee0dd7d3e11d93, State: Running, Role: LEADER
I20260810 01:39:24.657732 12488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:24.658037 12470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:24.658913 12488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17084460bdfa4b45a8ee0dd7d3e11d93. Latest consensus state: current_term: 1 leader_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } } }
I20260810 01:39:24.659119 12488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:24.659405 12490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } } }
I20260810 01:39:24.659516 12490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:24.660297 12470 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 01:39:24.665261 12500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:24.670020 12500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:24.676975 12500 catalog_manager.cc:1347] Generated new cluster ID: 1298191a7d9b4213901f2da6a8678666
I20260810 01:39:24.677042 12500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:39:24.685477 12500 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:39:24.686729 12500 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:39:24.696882 12500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Generated new TSK 0
I20260810 01:39:24.698169 12500 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:39:25.355283 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:39599
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:25.499043 12561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:25.499356 12561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:25.499490 12561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:25.503791 12561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:25.503871 12561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:25.503973 12561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:39:25.509723 12561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.205.148:57927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:39599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:25.510957 12561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:25.512130 12561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:25.522945 12571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:25.522945 12570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:25.523480 12574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:25.523871 12561 server_base.cc:1034] running on GCE node
I20260810 01:39:25.524345 12561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:25.525041 12561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:25.526223 12561 hybrid_clock.cc:648] HybridClock initialized: now 1786325965526188 us; error 51 us; skew 500 ppm
Aug 10 01:39:25 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:25.529271 12561 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:39:25.530252 12561 webserver.cc:460] Webserver started at http://127.24.205.129:41531/ using document root <none> and password file <none>
I20260810 01:39:25.530853 12561 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:25.530951 12561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:25.531235 12561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:39:25 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:25.546779 12561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "97705d5867394288bdae3a57eca298c6"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "a39acfa701f993195609f30618ccb77e"
server_key_iv: "23f0b9cc61c83343920efe01b76e0138"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:25.547772 12561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "97705d5867394288bdae3a57eca298c6"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "a39acfa701f993195609f30618ccb77e"
server_key_iv: "23f0b9cc61c83343920efe01b76e0138"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:25.553541 12561 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s
I20260810 01:39:25.586331 12586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:25.588305 12561 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.001s sys 0.001s
I20260810 01:39:25.588456 12561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "97705d5867394288bdae3a57eca298c6"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "a39acfa701f993195609f30618ccb77e"
server_key_iv: "23f0b9cc61c83343920efe01b76e0138"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:25.588632 12561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:25.613029 12561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:25.622578 12561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:25.622869 12561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:25.623703 12561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:25.624933 12561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:25.625051 12561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:25.625185 12561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:25.625275 12561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:25.639446 12561 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:44603
I20260810 01:39:25.640707 12561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:39:25.641530 12789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:44603 every 8 connection(s)
I20260810 01:39:25.646004 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 12561
I20260810 01:39:25.646166 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:39:25.646509 25398 external_mini_cluster.cc:1428] Setting key 89b0e58d2bd3b9337c23d92c32e69d54
Aug 10 01:39:25 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
I20260810 01:39:25.664572 12796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:25.645189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:60235 (local address 127.24.205.190:39599)
0810 01:39:25.646352 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:25.646364 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:25.647621 (+ 1257us) server_negotiation.cc:407] Connection header received
0810 01:39:25.650831 (+ 3210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:25.650834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:25.650891 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:25.650981 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:25.652645 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:25.653578 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:25.655535 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:25.655958 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:25.656099 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:25.659792 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:25.659798 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:25.659804 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:25.659835 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:25.661859 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:25.662412 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:25.662415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:25.662417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:25.662512 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:25.662934 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:25.662938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:25.662940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:25.663219 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:25.663324 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:25.664119 (+ 795us) server_negotiation.cc:299] Negotiation successful
0810 01:39:25.664277 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1064,"thread_start_us":95,"threads_started":1}
I20260810 01:39:25.666236 12794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:25.644117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:39599 (local address 127.24.205.129:60235)
0810 01:39:25.646650 (+ 2533us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:25.646805 (+ 155us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:25.650595 (+ 3790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:25.651263 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:25.651275 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:25.651666 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:25.652455 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:25.652478 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:25.653750 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:25.653756 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:25.655375 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:25.655389 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:25.656366 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:25.656373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:25.656634 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:25.657440 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:25.657467 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:25.659544 (+ 2077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:25.661990 (+ 2446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:25.661996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:25.662017 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:25.662291 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:25.662671 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:25.662674 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:25.662676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:25.662823 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:25.663383 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:25.663394 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:25.663770 (+ 376us) client_negotiation.cc:769] Sending connection context
0810 01:39:25.664764 (+ 994us) client_negotiation.cc:240] Negotiation successful
0810 01:39:25.665171 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1911,"thread_start_us":129,"threads_started":1}
I20260810 01:39:25.667883 12790 heartbeater.cc:347] Connected to a master server at 127.24.205.190:39599
I20260810 01:39:25.668179 12790 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:25.668807 12790 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:25.670405 12396 ts_manager.cc:194] Registered new tserver with Master: 97705d5867394288bdae3a57eca298c6 (127.24.205.129:44603)
I20260810 01:39:25.672031 12396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:60235
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:39:25.687412 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:39599
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:39:25 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 01:39:25.860589 12801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:25.860998 12801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:25.861117 12801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:25.865528 12801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:25.865612 12801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:25.865710 12801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:39:25.873327 12801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.205.148:57927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:39599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:25.874758 12801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:25.876161 12801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:25.889611 12810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:25.890101 12812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:25.889628 12809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:25.890656 12801 server_base.cc:1034] running on GCE node
I20260810 01:39:25.891173 12801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:25.891983 12801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:25.893205 12801 hybrid_clock.cc:648] HybridClock initialized: now 1786325965893182 us; error 37 us; skew 500 ppm
Aug 10 01:39:25 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:25.897073 12801 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:39:25.898262 12801 webserver.cc:460] Webserver started at http://127.24.205.130:34671/ using document root <none> and password file <none>
I20260810 01:39:25.899017 12801 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:25.899125 12801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:25.899451 12801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:39:25 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:25.915918 12801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "68f343adef5749a1beb28b86312e8547"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "803b385d95c2ed340dae3938e1ed24bb"
server_key_iv: "82a99494a022848c2f243df934edc0e2"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:25.916769 12801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "68f343adef5749a1beb28b86312e8547"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "803b385d95c2ed340dae3938e1ed24bb"
server_key_iv: "82a99494a022848c2f243df934edc0e2"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:25.925642 12801 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260810 01:39:25.945362 12830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:25.947229 12801 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:39:25.947384 12801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "68f343adef5749a1beb28b86312e8547"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "803b385d95c2ed340dae3938e1ed24bb"
server_key_iv: "82a99494a022848c2f243df934edc0e2"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:25.947539 12801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:25.971452 12801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:25.980508 12801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:25.980805 12801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:25.981598 12801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:25.982733 12801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:25.984201 12801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260810 01:39:25.984349 12801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:25.984418 12801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:25.995460 12801 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36597
I20260810 01:39:25.996848 12801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:39:25.999219 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 12801
I20260810 01:39:25.999344 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:39:25.999733 25398 external_mini_cluster.cc:1428] Setting key aa111277bfe8c71e27841312cbc70e91
I20260810 01:39:26.006871 13028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36597 every 8 connection(s)
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:26.021942 12796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:26.005198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:43417 (local address 127.24.205.190:39599)
0810 01:39:26.005341 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:26.005348 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:26.007667 (+ 2319us) server_negotiation.cc:407] Connection header received
0810 01:39:26.008989 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:26.008993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:26.009058 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:26.009112 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:26.010972 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.011805 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.013550 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.013807 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.013939 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:26.017545 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:26.017551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:26.017559 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:26.017584 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:26.019425 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:26.020222 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:26.020233 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:26.020236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:26.020339 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:26.020728 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:26.020732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:26.020733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:26.020933 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:26.021052 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:26.021601 (+ 549us) server_negotiation.cc:299] Negotiation successful
0810 01:39:26.021743 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:39:26.023001 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:26.005768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:39599 (local address 127.24.205.130:43417)
0810 01:39:26.007503 (+ 1735us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:26.007559 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:26.008729 (+ 1170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:26.009561 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:26.009570 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:26.010058 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:26.010781 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:26.010803 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.011982 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.011985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:26.013393 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:26.013404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.013987 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.013991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:26.014185 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:26.014880 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:26.014898 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:26.017349 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:26.019577 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:26.019587 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:26.019613 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:26.020091 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:26.020446 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:26.020449 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:26.020451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:26.020619 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:26.021045 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:26.021052 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:26.021341 (+ 289us) client_negotiation.cc:769] Sending connection context
0810 01:39:26.021549 (+ 208us) client_negotiation.cc:240] Negotiation successful
0810 01:39:26.021907 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1510,"thread_start_us":185,"threads_started":1}
I20260810 01:39:26.024439 13030 heartbeater.cc:347] Connected to a master server at 127.24.205.190:39599
I20260810 01:39:26.024701 13030 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:26.025234 13030 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:26.026340 12396 ts_manager.cc:194] Registered new tserver with Master: 68f343adef5749a1beb28b86312e8547 (127.24.205.130:36597)
I20260810 01:39:26.026942 12396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:43417
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:39:26.044247 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:39599
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325965, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
W20260810 01:39:26.215934 13038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:26.216379 13038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:26.216483 13038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:26.222122 13038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:26.222252 13038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:26.222385 13038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:39:26.229449 13038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.205.148:57927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:39599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:26.231149 13038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:26.232753 13038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:26.244249 13051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:26.244268 13053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:26.244517 13049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:26.244889 13038 server_base.cc:1034] running on GCE node
I20260810 01:39:26.245556 13038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:26.246394 13038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:26.247576 13038 hybrid_clock.cc:648] HybridClock initialized: now 1786325966247504 us; error 88 us; skew 500 ppm
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:26.251224 13038 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:39:26.252388 13038 webserver.cc:460] Webserver started at http://127.24.205.131:46369/ using document root <none> and password file <none>
I20260810 01:39:26.253211 13038 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:26.253367 13038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:26.253686 13038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:26.278904 13038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "f8e63c74d7fe44bdb2c8d076d472da96"
format_stamp: "Formatted at 2026-08-10 01:39:26 on dist-test-slave-t3q3"
server_key: "e37a88a8a26e4a21351c147506d961a5"
server_key_iv: "01e166cd155ce0e37208ccd264802148"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:26.279809 13038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "f8e63c74d7fe44bdb2c8d076d472da96"
format_stamp: "Formatted at 2026-08-10 01:39:26 on dist-test-slave-t3q3"
server_key: "e37a88a8a26e4a21351c147506d961a5"
server_key_iv: "01e166cd155ce0e37208ccd264802148"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:26.297878 13038 fs_manager.cc:691] Time spent creating directory manager: real 0.018s user 0.000s sys 0.003s
I20260810 01:39:26.329551 13066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:26.333653 13038 fs_manager.cc:725] Time spent opening block manager: real 0.018s user 0.001s sys 0.000s
I20260810 01:39:26.333854 13038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "f8e63c74d7fe44bdb2c8d076d472da96"
format_stamp: "Formatted at 2026-08-10 01:39:26 on dist-test-slave-t3q3"
server_key: "e37a88a8a26e4a21351c147506d961a5"
server_key_iv: "01e166cd155ce0e37208ccd264802148"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:26.334044 13038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:26.350279 13038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:26.354708 13038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:26.354944 13038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:26.355793 13038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:26.357398 13038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:26.357524 13038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:26.357637 13038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:26.357718 13038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:26.371160 13038 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:38295
I20260810 01:39:26.372593 13038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:39:26.375614 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 13038
I20260810 01:39:26.375751 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:39:26.376083 25398 external_mini_cluster.cc:1428] Setting key c950a2828844600b1f363e5f2cf34b8f
I20260810 01:39:26.381646 13252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:38295 every 8 connection(s)
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:26.402974 12796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:26.384242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:52755 (local address 127.24.205.190:39599)
0810 01:39:26.384368 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:26.384373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:26.386586 (+ 2213us) server_negotiation.cc:407] Connection header received
0810 01:39:26.388155 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:26.388159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:26.388217 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:26.388273 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:26.390361 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.391129 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.393260 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.393680 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.393765 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:26.398047 (+ 4282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:26.398052 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:26.398055 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:26.398098 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:26.400223 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:26.400919 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:26.400923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:26.400925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:26.401045 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:26.401554 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:26.401559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:26.401560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:26.401793 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:26.401880 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:26.402672 (+ 792us) server_negotiation.cc:299] Negotiation successful
0810 01:39:26.402803 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:39:26.404143 13255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:26.384591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:39599 (local address 127.24.205.131:52755)
0810 01:39:26.386425 (+ 1834us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:26.386481 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:26.387869 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:26.388749 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:26.388757 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:26.389314 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:26.390195 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:26.390217 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.391287 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.391291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:26.393073 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:26.393098 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:26.393989 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:26.393992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:26.394306 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:26.395278 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:26.395298 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:26.397795 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:26.400382 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:26.400387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:26.400402 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:26.400762 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:26.401192 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:26.401195 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:26.401197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:26.401416 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:26.401951 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:26.401957 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:26.402273 (+ 316us) client_negotiation.cc:769] Sending connection context
0810 01:39:26.402478 (+ 205us) client_negotiation.cc:240] Negotiation successful
0810 01:39:26.402831 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1594,"thread_start_us":228,"threads_started":1}
I20260810 01:39:26.405949 13253 heartbeater.cc:347] Connected to a master server at 127.24.205.190:39599
I20260810 01:39:26.406327 13253 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:26.407112 13253 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:26.408342 12396 ts_manager.cc:194] Registered new tserver with Master: f8e63c74d7fe44bdb2c8d076d472da96 (127.24.205.131:38295)
I20260810 01:39:26.409205 12396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:52755
I20260810 01:39:26.414378 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:39:26.415144 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 12561
I20260810 01:39:26.479557 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 12801
I20260810 01:39:26.491925 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 13038
I20260810 01:39:26.509907 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 12351
I20260810 01:39:26.523870 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:39599
--webserver_interface=127.24.205.190
--webserver_port=39815
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:39599
--ranger_config_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:26.640049 13256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:26.640396 13256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:26.640512 13256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:26.644616 13256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:26.644712 13256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:26.644748 13256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:26.644810 13256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:26.644850 13256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:26.650529 13256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:39599
--ranger_config_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:39599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:26.651762 13256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:26.652928 13256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:26.662232 13267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:26.662235 13270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:26.662312 13263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:26.662498 13256 server_base.cc:1034] running on GCE node
I20260810 01:39:26.663247 13256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:26.664556 13256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:26.665784 13256 hybrid_clock.cc:648] HybridClock initialized: now 1786325966665773 us; error 38 us; skew 500 ppm
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:26.669392 13256 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:26.670526 13256 webserver.cc:460] Webserver started at http://127.24.205.190:39815/ using document root <none> and password file <none>
I20260810 01:39:26.671168 13256 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:26.671278 13256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:26.721887 13256 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:39:26.724658 13281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:26.726052 13256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:26.726244 13256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "17084460bdfa4b45a8ee0dd7d3e11d93"
format_stamp: "Formatted at 2026-08-10 01:39:24 on dist-test-slave-t3q3"
server_key: "e53d7603fc6e8e7288fea4526edafa61"
server_key_iv: "839cd92bdf294c0f6018f7c7e8b902cc"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:26.726845 13256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:26.747268 13256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:26.754052 13256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:26.754295 13256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:26.762454 13256 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:39599
I20260810 01:39:26.762494 13363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:39599 every 8 connection(s)
I20260810 01:39:26.763651 13256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:26.768255 13365 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:39:26.770028 13365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Bootstrap starting.
I20260810 01:39:26.772737 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 13256
I20260810 01:39:26.773320 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:44603
--local_ip_for_outbound_sockets=127.24.205.129
--tserver_master_addrs=127.24.205.190:39599
--webserver_port=41531
--webserver_interface=127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:39:26.787065 13365 log.cc:824] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:26.794202 13365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:39:26.794664 13365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Bootstrap complete.
I20260810 01:39:26.799130 13365 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:26.799589 13365 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17084460bdfa4b45a8ee0dd7d3e11d93, State: Initialized, Role: FOLLOWER
I20260810 01:39:26.800166 13365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:26.800321 13365 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:39:26.800412 13365 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:39:26.800534 13365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:39:26.802524 13365 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:26.802877 13365 leader_election.cc:302] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17084460bdfa4b45a8ee0dd7d3e11d93; no voters:
I20260810 01:39:26.803243 13365 leader_election.cc:288] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:39:26.803334 13370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:39:26.803604 13370 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [term 2 LEADER]: Becoming Leader. State: Replica: 17084460bdfa4b45a8ee0dd7d3e11d93, State: Running, Role: LEADER
I20260810 01:39:26.803977 13370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } }
I20260810 01:39:26.804607 13365 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:26.805473 13373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } } }
I20260810 01:39:26.805599 13373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:26.806092 13374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17084460bdfa4b45a8ee0dd7d3e11d93. Latest consensus state: current_term: 2 leader_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17084460bdfa4b45a8ee0dd7d3e11d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 39599 } } }
I20260810 01:39:26.806231 13374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:26.806941 13387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:26.807214 13365 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 01:39:26.813619 13387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:26.814738 13387 catalog_manager.cc:1259] Loaded cluster ID: 1298191a7d9b4213901f2da6a8678666
I20260810 01:39:26.814854 13387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:39:26.818369 13387 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:39:26.819453 13387 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Loaded TSK: 0
I20260810 01:39:26.821105 13387 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:39:26.933086 13368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:26.933579 13368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:26.933720 13368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:26.940434 13368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:26.940536 13368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:26.940626 13368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:39:26.949321 13368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:44603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=41531
--tserver_master_addrs=127.24.205.190:39599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:26.950979 13368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:26.952422 13368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:26.967453 13435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:26.967772 13432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:26.967816 13429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:26.968147 13368 server_base.cc:1034] running on GCE node
I20260810 01:39:26.968690 13368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:26.969542 13368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:26.970844 13368 hybrid_clock.cc:648] HybridClock initialized: now 1786325966970809 us; error 45 us; skew 500 ppm
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:26.974849 13368 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:39:26.976122 13368 webserver.cc:460] Webserver started at http://127.24.205.129:41531/ using document root <none> and password file <none>
I20260810 01:39:26.976900 13368 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:26.977087 13368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:39:26 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:27.004161 13368 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:39:27.008544 13446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.010283 13368 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260810 01:39:27.010432 13368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "97705d5867394288bdae3a57eca298c6"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "a39acfa701f993195609f30618ccb77e"
server_key_iv: "23f0b9cc61c83343920efe01b76e0138"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:27.011173 13368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:27.036453 13368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:27.041483 13368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:27.041734 13368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:27.042532 13368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:27.043681 13368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:27.043807 13368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.043959 13368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:27.044091 13368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.057789 13368 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:44603
I20260810 01:39:27.058003 13630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:44603 every 8 connection(s)
I20260810 01:39:27.059415 13368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:39:27.066553 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 13368
I20260810 01:39:27.067150 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:36597
--local_ip_for_outbound_sockets=127.24.205.130
--tserver_master_addrs=127.24.205.190:39599
--webserver_port=34671
--webserver_interface=127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325966, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:27.087671 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:27.064890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:33569 (local address 127.24.205.190:39599)
0810 01:39:27.065410 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:27.065437 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:27.065855 (+ 418us) server_negotiation.cc:407] Connection header received
0810 01:39:27.067477 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:27.067494 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:27.067964 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:27.068408 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:27.070742 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.072537 (+ 1795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.074710 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.075658 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.075841 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:27.079898 (+ 4057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:27.079907 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:27.079931 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:27.079990 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:27.082767 (+ 2777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.083606 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.083613 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.083620 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.083806 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.084349 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.084354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.084356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.084951 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:27.085086 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:27.086012 (+ 926us) server_negotiation.cc:299] Negotiation successful
0810 01:39:27.086394 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":148,"threads_started":1}
I20260810 01:39:27.090026 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:27.065082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:39599 (local address 127.24.205.129:33569)
0810 01:39:27.065661 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:27.065709 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:27.066908 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:27.068557 (+ 1649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:27.068571 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:27.069747 (+ 1176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:27.070482 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:27.070508 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.072755 (+ 2247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.072762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:27.074522 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:27.074548 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.076211 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.076218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:27.076494 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:27.077368 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:27.077398 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:27.079606 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:27.082932 (+ 3326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:27.082939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:27.082956 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:27.083379 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:27.083957 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:27.083961 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:27.083963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:27.084205 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:27.085190 (+ 985us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:27.085197 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:27.085565 (+ 368us) client_negotiation.cc:769] Sending connection context
0810 01:39:27.088629 (+ 3064us) client_negotiation.cc:240] Negotiation successful
0810 01:39:27.089012 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":169,"threads_started":1}
I20260810 01:39:27.093396 13631 heartbeater.cc:347] Connected to a master server at 127.24.205.190:39599
I20260810 01:39:27.093699 13631 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:27.094424 13631 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
W20260810 01:39:27.096941 13631 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:39599 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 01:39:27.097093 13631 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:27.097287 13631 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:27.098176 13631 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:27.098362 13631 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
W20260810 01:39:27.099205 13631 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:39:27.248639 13638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:27.249176 13638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:27.249294 13638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:27.256552 13638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:27.256700 13638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:27.256844 13638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:39:27.266290 13638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:36597
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=34671
--tserver_master_addrs=127.24.205.190:39599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:27.267803 13638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:27.269241 13638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:27.284021 13650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:27.284237 13647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:27.284292 13645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:27.284492 13638 server_base.cc:1034] running on GCE node
I20260810 01:39:27.285563 13638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:27.286459 13638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:27.287683 13638 hybrid_clock.cc:648] HybridClock initialized: now 1786325967287640 us; error 61 us; skew 500 ppm
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:27.291476 13638 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:39:27.292695 13638 webserver.cc:460] Webserver started at http://127.24.205.130:34671/ using document root <none> and password file <none>
I20260810 01:39:27.293293 13638 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:27.293373 13638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:27.327131 13638 fs_manager.cc:709] Time spent opening directory manager: real 0.012s user 0.003s sys 0.000s
I20260810 01:39:27.330559 13661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.332280 13638 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260810 01:39:27.332399 13638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "68f343adef5749a1beb28b86312e8547"
format_stamp: "Formatted at 2026-08-10 01:39:25 on dist-test-slave-t3q3"
server_key: "803b385d95c2ed340dae3938e1ed24bb"
server_key_iv: "82a99494a022848c2f243df934edc0e2"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:27.333179 13638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:27.355561 13638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:27.358934 13638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:27.359171 13638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:27.359838 13638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:27.360849 13638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:27.360931 13638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.361016 13638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:27.361069 13638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.372298 13638 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36597
I20260810 01:39:27.372609 13868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36597 every 8 connection(s)
I20260810 01:39:27.373732 13638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:39:27.381534 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 13638
I20260810 01:39:27.382125 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.205.148:57927/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:38295
--local_ip_for_outbound_sockets=127.24.205.131
--tserver_master_addrs=127.24.205.190:39599
--webserver_port=46369
--webserver_interface=127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:27.391362 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:27.375764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:44399 (local address 127.24.205.190:39599)
0810 01:39:27.375905 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:27.375909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:27.377024 (+ 1115us) server_negotiation.cc:407] Connection header received
0810 01:39:27.378133 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:27.378137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:27.378197 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:27.378259 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:27.380100 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.380926 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.382692 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.383048 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.383137 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:27.386628 (+ 3491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:27.386633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:27.386639 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:27.386671 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:27.388521 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.389300 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.389304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.389307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.389416 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.389908 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.389912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.389914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.390158 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:27.390268 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:27.391038 (+ 770us) server_negotiation.cc:299] Negotiation successful
0810 01:39:27.391186 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:39:27.392652 13871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:27.376312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:39599 (local address 127.24.205.130:44399)
0810 01:39:27.376855 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:27.376910 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:27.377847 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:27.378766 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:27.378776 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:27.379162 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:27.379883 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:27.379905 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.381100 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.381103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:27.382536 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:27.382548 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.383316 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.383318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:27.383470 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:27.384341 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:27.384368 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:27.386406 (+ 2038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:27.388675 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:27.388684 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:27.388705 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:27.389167 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:27.389545 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:27.389552 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:27.389555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:27.389777 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:27.390291 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:27.390302 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:27.390697 (+ 395us) client_negotiation.cc:769] Sending connection context
0810 01:39:27.390962 (+ 265us) client_negotiation.cc:240] Negotiation successful
0810 01:39:27.391373 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":141,"threads_started":1}
I20260810 01:39:27.394147 13869 heartbeater.cc:347] Connected to a master server at 127.24.205.190:39599
I20260810 01:39:27.394443 13869 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:27.395128 13869 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
W20260810 01:39:27.397132 13869 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:39599 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 01:39:27.397274 13869 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:27.397485 13869 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:27.398358 13869 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:27.398535 13869 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
W20260810 01:39:27.399278 13869 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:39:27.524827 13873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:27.525095 13873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:27.525197 13873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:27.529707 13873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:27.529784 13873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:27.529868 13873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:39:27.537014 13873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.205.148:57927/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:38295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=46369
--tserver_master_addrs=127.24.205.190:39599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:27.538125 13873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:27.539511 13873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:27.551219 13892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:27.551241 13886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:27.551908 13873 server_base.cc:1034] running on GCE node
W20260810 01:39:27.551694 13889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:27.555502 13873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:27.556439 13873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:27.557667 13873 hybrid_clock.cc:648] HybridClock initialized: now 1786325967557635 us; error 44 us; skew 500 ppm
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:27.561470 13873 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:39:27.562776 13873 webserver.cc:460] Webserver started at http://127.24.205.131:46369/ using document root <none> and password file <none>
I20260810 01:39:27.563560 13873 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:27.563675 13873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:27.586149 13873 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260810 01:39:27.589502 13906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.591097 13873 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:39:27.591300 13873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "f8e63c74d7fe44bdb2c8d076d472da96"
format_stamp: "Formatted at 2026-08-10 01:39:26 on dist-test-slave-t3q3"
server_key: "e37a88a8a26e4a21351c147506d961a5"
server_key_iv: "01e166cd155ce0e37208ccd264802148"
server_key_version: "kuduclusterkey@0"
I20260810 01:39:27.592109 13873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:27.630251 13873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:27.633904 13873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:27.634182 13873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:27.634902 13873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:27.635888 13873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:27.635962 13873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:27.636040 13873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:27.636111 13873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260810 01:39:27.647517 13873 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:38295
I20260810 01:39:27.647610 14125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:38295 every 8 connection(s)
I20260810 01:39:27.648726 13873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:39:27.653357 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 13873
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:27.668104 14135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:27.654049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34600 (local address 127.24.205.190:39599)
0810 01:39:27.654351 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:27.654358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:27.654607 (+ 249us) server_negotiation.cc:407] Connection header received
0810 01:39:27.654774 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:27.654777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:27.654845 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:27.654933 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:27.655875 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.656694 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.658446 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.658779 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.658892 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:27.662266 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:27.662270 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:27.662273 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:27.662298 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:27.665003 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.666098 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.666102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.666103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.666191 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.666655 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.666658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.666659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.666846 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:27.667054 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:27.667753 (+ 699us) server_negotiation.cc:299] Negotiation successful
0810 01:39:27.667881 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":224,"thread_start_us":120,"threads_started":1}
I20260810 01:39:27.670256 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:27.651261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:39599 (local address 127.24.205.131:41491)
0810 01:39:27.651731 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:27.651784 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:27.652700 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:27.653557 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:27.653568 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:27.653919 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:27.654650 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:27.654672 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.655607 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.655610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:27.656971 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:27.656981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.657535 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.657540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:27.657708 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:27.660230 (+ 2522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:27.660250 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:27.662056 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:27.665063 (+ 3007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:27.665070 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:27.665087 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:27.665443 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:27.665787 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:27.665790 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:27.665793 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:27.665981 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:27.667136 (+ 1155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:27.667143 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:27.667482 (+ 339us) client_negotiation.cc:769] Sending connection context
0810 01:39:27.668840 (+ 1358us) client_negotiation.cc:240] Negotiation successful
0810 01:39:27.669211 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":140,"threads_started":1}
I20260810 01:39:27.668769 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:27.650880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:41491 (local address 127.24.205.190:39599)
0810 01:39:27.651054 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:27.651059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:27.651921 (+ 862us) server_negotiation.cc:407] Connection header received
0810 01:39:27.652923 (+ 1002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:27.652983 (+ 60us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:27.653076 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:27.653200 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:27.654855 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.655470 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.657093 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:27.657369 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:27.657481 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:27.662330 (+ 4849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:27.662335 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:27.662337 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:27.662395 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:27.664918 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.665573 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.665577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.665579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.665672 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:27.666324 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:27.666326 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:27.666328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:27.666539 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:27.666620 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:27.668507 (+ 1887us) server_negotiation.cc:299] Negotiation successful
0810 01:39:27.668625 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 01:39:27.672937 14126 heartbeater.cc:347] Connected to a master server at 127.24.205.190:39599
I20260810 01:39:27.673239 14126 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:27.673875 14126 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:27.675256 13301 ts_manager.cc:194] Registered new tserver with Master: f8e63c74d7fe44bdb2c8d076d472da96 (127.24.205.131:38295)
I20260810 01:39:27.676486 13301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:41491
Aug 10 01:39:27 dist-test-slave-t3q3 krb5kdc[11614](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:28.099449 13631 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:28.099768 13631 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:28.100575 13301 ts_manager.cc:194] Registered new tserver with Master: 97705d5867394288bdae3a57eca298c6 (127.24.205.129:44603)
I20260810 01:39:28.101408 13301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:33569
Aug 10 01:39:28 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
I20260810 01:39:28.399519 13869 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:28.399834 13869 heartbeater.cc:511] Master 127.24.205.190:39599 requested a full tablet report, sending...
I20260810 01:39:28.400731 13301 ts_manager.cc:194] Registered new tserver with Master: 68f343adef5749a1beb28b86312e8547 (127.24.205.130:36597)
I20260810 01:39:28.401494 13301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:44399
I20260810 01:39:28.403424 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:39:28.415119 14152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.405208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34602 (local address 127.24.205.190:39599)
0810 01:39:28.405508 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:28.405513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:28.405614 (+ 101us) server_negotiation.cc:407] Connection header received
0810 01:39:28.405783 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:28.405786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:28.405836 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:28.405944 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:28.406818 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.407617 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.408899 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.409248 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.409354 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.411039 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:28.411043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:28.411046 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:28.411075 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:28.412890 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:28.413411 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:28.413414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:28.413416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:28.413512 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:28.413837 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:28.413840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:28.413842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:28.414056 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:28.414189 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:28.414818 (+ 629us) server_negotiation.cc:299] Negotiation successful
0810 01:39:28.414945 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":72,"threads_started":1}
I20260810 01:39:28.419579 13301 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:39:28.424181 13301 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:39:28.446795 14171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.438789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:38295 (local address 127.0.0.1:40036)
0810 01:39:28.440594 (+ 1805us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:28.440606 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:28.440697 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:28.441356 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:28.441363 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:28.441386 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:28.441515 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.441522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.443127 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.443131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.444587 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.444599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.446122 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.446127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.446248 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.446291 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 01:39:28.446434 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 01:39:28.446631 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1737,"thread_start_us":160,"threads_started":1}
I20260810 01:39:28.448194 14174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.439540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40036 (local address 127.24.205.131:38295)
0810 01:39:28.440588 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:28.440595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:28.440701 (+ 106us) server_negotiation.cc:407] Connection header received
0810 01:39:28.440810 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:28.440816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:28.441031 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:28.441184 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:28.441675 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.442950 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.444757 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.445755 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.445882 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.446045 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:28.447900 (+ 1855us) server_negotiation.cc:299] Negotiation successful
0810 01:39:28.448008 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":933,"thread_start_us":166,"threads_started":1}
I20260810 01:39:28.452533 14162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.438983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36597 (local address 127.0.0.1:34046)
0810 01:39:28.441429 (+ 2446us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:28.441441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:28.441515 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:28.443001 (+ 1486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:28.443004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:28.443021 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:28.443113 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.443119 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.446818 (+ 3699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.446821 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.447926 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.447937 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.452153 (+ 4216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.452157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.452253 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.452277 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:39:28.452337 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 01:39:28.452405 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2387,"thread_start_us":85,"threads_started":1}
I20260810 01:39:28.452091 13982 tablet_service.cc:1467] Processing CreateTablet for tablet 06e13ef454024e3badf8199356352672 (DEFAULT_TABLE table=test-table [id=12a9f221b43647738b0ae7822354a0a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:28.453191 14173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.438107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44603 (local address 127.0.0.1:46192)
0810 01:39:28.440171 (+ 2064us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:28.440223 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:28.440349 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:28.443246 (+ 2897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:28.443249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:28.443262 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:28.443335 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.443339 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.448100 (+ 4761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.448103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.449924 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.449935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.452835 (+ 2900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.452839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.452923 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.452944 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:39:28.453010 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 01:39:28.453073 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1835,"thread_start_us":113,"threads_started":1}
I20260810 01:39:28.453972 13982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e13ef454024e3badf8199356352672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:28.454620 14163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.438268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46192 (local address 127.24.205.129:44603)
0810 01:39:28.440923 (+ 2655us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:28.440930 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:28.440952 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:39:28.441025 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:28.441030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:28.441213 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:28.443466 (+ 2253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:28.443611 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.446411 (+ 2800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.450076 (+ 3665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.450909 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.454186 (+ 3277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.454324 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:28.454375 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 01:39:28.454469 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2553,"thread_start_us":153,"threads_started":1}
I20260810 01:39:28.455202 14175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.440094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34046 (local address 127.24.205.130:36597)
0810 01:39:28.441732 (+ 1638us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:28.441739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:28.441759 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:39:28.441825 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:28.441830 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:28.442717 (+ 887us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:28.442861 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:28.444142 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.446702 (+ 2560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.451040 (+ 4338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.451834 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.451953 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.454871 (+ 2918us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:28.454975 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 01:39:28.455074 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1545,"thread_start_us":84,"threads_started":1}
I20260810 01:39:28.458601 13757 tablet_service.cc:1467] Processing CreateTablet for tablet 06e13ef454024e3badf8199356352672 (DEFAULT_TABLE table=test-table [id=12a9f221b43647738b0ae7822354a0a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:28.459095 13509 tablet_service.cc:1467] Processing CreateTablet for tablet 06e13ef454024e3badf8199356352672 (DEFAULT_TABLE table=test-table [id=12a9f221b43647738b0ae7822354a0a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:28.459791 13757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e13ef454024e3badf8199356352672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:28.460132 13509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e13ef454024e3badf8199356352672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:28.471917 14179 tablet_bootstrap.cc:492] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Bootstrap starting.
I20260810 01:39:28.476147 14179 tablet_bootstrap.cc:654] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:28.477731 14179 log.cc:824] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:28.478713 14181 tablet_bootstrap.cc:492] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Bootstrap starting.
I20260810 01:39:28.481228 14183 tablet_bootstrap.cc:492] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6: Bootstrap starting.
I20260810 01:39:28.482651 14181 tablet_bootstrap.cc:654] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:28.484262 14183 tablet_bootstrap.cc:654] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:28.484357 14181 log.cc:824] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:28.485590 14183 log.cc:824] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:28.488569 14181 tablet_bootstrap.cc:492] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: No bootstrap required, opened a new log
I20260810 01:39:28.488829 14181 ts_tablet_manager.cc:1397] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260810 01:39:28.489014 14183 tablet_bootstrap.cc:492] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6: No bootstrap required, opened a new log
I20260810 01:39:28.489230 14183 ts_tablet_manager.cc:1397] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20260810 01:39:28.494465 14181 raft_consensus.cc:348] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.494752 14181 raft_consensus.cc:374] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:28.494807 14181 raft_consensus.cc:729] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8e63c74d7fe44bdb2c8d076d472da96, State: Initialized, Role: FOLLOWER
I20260810 01:39:28.495151 14183 raft_consensus.cc:348] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.495321 14181 consensus_queue.cc:260] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.495394 14183 raft_consensus.cc:374] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:28.495456 14183 raft_consensus.cc:729] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97705d5867394288bdae3a57eca298c6, State: Initialized, Role: FOLLOWER
I20260810 01:39:28.496090 14183 consensus_queue.cc:260] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.496857 14181 ts_tablet_manager.cc:1428] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260810 01:39:28.497283 14126 heartbeater.cc:503] Master 127.24.205.190:39599 was elected leader, sending a full tablet report...
I20260810 01:39:28.497496 14183 ts_tablet_manager.cc:1428] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260810 01:39:28.499231 14179 tablet_bootstrap.cc:492] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: No bootstrap required, opened a new log
I20260810 01:39:28.499413 13631 heartbeater.cc:503] Master 127.24.205.190:39599 was elected leader, sending a full tablet report...
I20260810 01:39:28.499449 14179 ts_tablet_manager.cc:1397] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.005s
I20260810 01:39:28.505704 14179 raft_consensus.cc:348] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.505986 14179 raft_consensus.cc:374] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:28.506067 14179 raft_consensus.cc:729] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f343adef5749a1beb28b86312e8547, State: Initialized, Role: FOLLOWER
I20260810 01:39:28.506711 14179 consensus_queue.cc:260] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.507596 13869 heartbeater.cc:503] Master 127.24.205.190:39599 was elected leader, sending a full tablet report...
I20260810 01:39:28.508132 14179 ts_tablet_manager.cc:1428] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Time spent starting tablet: real 0.009s user 0.003s sys 0.005s
W20260810 01:39:28.561647 13634 tablet.cc:2369] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:39:28.626046 13870 tablet.cc:2369] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 01:39:28 dist-test-slave-t3q3 krb5kdc[11614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325967, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for HTTP/127.24.205.148@KRBTEST.COM
W20260810 01:39:28.651463 14128 tablet.cc:2369] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:39:28.849076 14190 raft_consensus.cc:482] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:28.849505 14190 raft_consensus.cc:504] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.851219 14190 leader_election.cc:288] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f343adef5749a1beb28b86312e8547 (127.24.205.130:36597), f8e63c74d7fe44bdb2c8d076d472da96 (127.24.205.131:38295)
I20260810 01:39:28.857980 14175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.851928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:33931 (local address 127.24.205.130:36597)
0810 01:39:28.852045 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:28.852049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:28.852091 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:39:28.852266 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:28.852270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:28.852322 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:28.852370 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:28.853092 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.853957 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.856121 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.856746 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.856862 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.856919 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:28.857743 (+ 824us) server_negotiation.cc:299] Negotiation successful
0810 01:39:28.857834 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:39:28.857991 14174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.852720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:41847 (local address 127.24.205.131:38295)
0810 01:39:28.852834 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:28.852838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:28.853079 (+ 241us) server_negotiation.cc:407] Connection header received
0810 01:39:28.853265 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:28.853268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:28.853314 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:28.853358 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:28.853946 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.854684 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.856532 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.857147 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.857243 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.857289 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:28.857775 (+ 486us) server_negotiation.cc:299] Negotiation successful
0810 01:39:28.857862 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:39:28.858606 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.852313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:38295 (local address 127.24.205.129:41847)
0810 01:39:28.852993 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:28.853006 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:28.853148 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:28.853484 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:28.853487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:28.853502 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:28.853803 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.853811 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.854834 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.854836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.856389 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.856400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.857387 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.857390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.857620 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.857652 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 01:39:28.858213 (+ 561us) client_negotiation.cc:240] Negotiation successful
0810 01:39:28.858299 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"mutex_wait_us":59,"thread_start_us":109,"threads_started":1}
I20260810 01:39:28.858887 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.851489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36597 (local address 127.24.205.129:33931)
0810 01:39:28.851911 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:28.851930 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:28.852100 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:28.852555 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:28.852575 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:28.852600 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:28.852910 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.852920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.854116 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.854119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.855933 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:28.855945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.857356 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.857360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:28.857520 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.857608 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 01:39:28.858535 (+ 927us) client_negotiation.cc:240] Negotiation successful
0810 01:39:28.858667 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":30,"thread_start_us":134,"threads_started":1}
I20260810 01:39:28.859634 14032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e13ef454024e3badf8199356352672" candidate_uuid: "97705d5867394288bdae3a57eca298c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" is_pre_election: true
I20260810 01:39:28.859850 13758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e13ef454024e3badf8199356352672" candidate_uuid: "97705d5867394288bdae3a57eca298c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f343adef5749a1beb28b86312e8547" is_pre_election: true
I20260810 01:39:28.860085 14032 raft_consensus.cc:2454] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97705d5867394288bdae3a57eca298c6 in term 0.
I20260810 01:39:28.860227 13758 raft_consensus.cc:2454] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97705d5867394288bdae3a57eca298c6 in term 0.
I20260810 01:39:28.860715 13447 leader_election.cc:302] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97705d5867394288bdae3a57eca298c6, f8e63c74d7fe44bdb2c8d076d472da96; no voters:
I20260810 01:39:28.861073 14190 raft_consensus.cc:2781] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:39:28.861177 14190 raft_consensus.cc:482] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:39:28.861223 14190 raft_consensus.cc:3037] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:28.863152 14190 raft_consensus.cc:504] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.863569 14190 leader_election.cc:288] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [CANDIDATE]: Term 1 election: Requested vote from peers 68f343adef5749a1beb28b86312e8547 (127.24.205.130:36597), f8e63c74d7fe44bdb2c8d076d472da96 (127.24.205.131:38295)
I20260810 01:39:28.864194 13758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e13ef454024e3badf8199356352672" candidate_uuid: "97705d5867394288bdae3a57eca298c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f343adef5749a1beb28b86312e8547"
I20260810 01:39:28.864213 14032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e13ef454024e3badf8199356352672" candidate_uuid: "97705d5867394288bdae3a57eca298c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8e63c74d7fe44bdb2c8d076d472da96"
I20260810 01:39:28.864346 14032 raft_consensus.cc:3037] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:28.864351 13758 raft_consensus.cc:3037] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:28.865800 14032 raft_consensus.cc:2454] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97705d5867394288bdae3a57eca298c6 in term 1.
I20260810 01:39:28.866170 13758 raft_consensus.cc:2454] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97705d5867394288bdae3a57eca298c6 in term 1.
I20260810 01:39:28.866240 13447 leader_election.cc:302] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97705d5867394288bdae3a57eca298c6, f8e63c74d7fe44bdb2c8d076d472da96; no voters:
I20260810 01:39:28.866489 14190 raft_consensus.cc:2781] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:28.866730 14190 raft_consensus.cc:686] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [term 1 LEADER]: Becoming Leader. State: Replica: 97705d5867394288bdae3a57eca298c6, State: Running, Role: LEADER
I20260810 01:39:28.867133 14190 consensus_queue.cc:237] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } }
I20260810 01:39:28.871151 13301 catalog_manager.cc:5495] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97705d5867394288bdae3a57eca298c6 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "97705d5867394288bdae3a57eca298c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97705d5867394288bdae3a57eca298c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 44603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 } health_report { overall_health: UNKNOWN } } }
I20260810 01:39:28.899683 14163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.895212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46194 (local address 127.24.205.129:44603)
0810 01:39:28.895338 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:28.895342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:28.895420 (+ 78us) server_negotiation.cc:407] Connection header received
0810 01:39:28.895600 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:28.895603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:28.895706 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:28.895840 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:39:28.896171 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.896794 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.897818 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:28.898057 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:28.898173 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:28.898511 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:39:28.898958 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:39:28.899255 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:28.899300 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 01:39:28.899368 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:39:28.907781 13758 raft_consensus.cc:1261] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 1 FOLLOWER]: Refusing update from remote peer 97705d5867394288bdae3a57eca298c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:28.907781 14032 raft_consensus.cc:1261] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 1 FOLLOWER]: Refusing update from remote peer 97705d5867394288bdae3a57eca298c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:28.908648 14190 consensus_queue.cc:1035] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8e63c74d7fe44bdb2c8d076d472da96" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:28.909180 14201 consensus_queue.cc:1035] T 06e13ef454024e3badf8199356352672 P 97705d5867394288bdae3a57eca298c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f343adef5749a1beb28b86312e8547" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:28.918627 14209 mvcc.cc:205] Tried to move back new op lower bound from 7316791168636858368 to 7316791168483557376. Current Snapshot: MvccSnapshot[applied={T|T < 7316791168636858368}]
I20260810 01:39:28.919143 14217 mvcc.cc:205] Tried to move back new op lower bound from 7316791168636858368 to 7316791168483557376. Current Snapshot: MvccSnapshot[applied={T|T < 7316791168636858368}]
I20260810 01:39:28.922928 14218 mvcc.cc:205] Tried to move back new op lower bound from 7316791168636858368 to 7316791168483557376. Current Snapshot: MvccSnapshot[applied={T|T < 7316791168636858368}]
I20260810 01:39:28.931397 13303 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:28.931639 13303 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:28.934360 13303 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 17084460bdfa4b45a8ee0dd7d3e11d93: Sending DeleteTablet for 3 replicas of tablet 06e13ef454024e3badf8199356352672
I20260810 01:39:28.935405 13509 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e13ef454024e3badf8199356352672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:28 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:46192
I20260810 01:39:28.935451 13982 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e13ef454024e3badf8199356352672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:28 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:40036
I20260810 01:39:28.935879 13757 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e13ef454024e3badf8199356352672 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:28 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:34046
I20260810 01:39:28.936579 14231 tablet_replica.cc:330] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: stopping tablet replica
I20260810 01:39:28.937022 14231 raft_consensus.cc:2229] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:39:28.937335 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 13368
I20260810 01:39:28.937549 14231 raft_consensus.cc:2258] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:28.944523 14229 tablet_replica.cc:330] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: stopping tablet replica
I20260810 01:39:28.944988 14229 raft_consensus.cc:2229] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:39:28.945487 14229 raft_consensus.cc:2258] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:28.953894 14231 ts_tablet_manager.cc:1905] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:28.954064 14229 ts_tablet_manager.cc:1905] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:28.957263 14229 ts_tablet_manager.cc:1918] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:28.957381 14229 log.cc:1196] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/06e13ef454024e3badf8199356352672
I20260810 01:39:28.957731 14229 ts_tablet_manager.cc:1939] T 06e13ef454024e3badf8199356352672 P f8e63c74d7fe44bdb2c8d076d472da96: Deleting consensus metadata
I20260810 01:39:28.958521 14231 ts_tablet_manager.cc:1918] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:28.958724 14231 log.cc:1196] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/06e13ef454024e3badf8199356352672
I20260810 01:39:28.959139 14231 ts_tablet_manager.cc:1939] T 06e13ef454024e3badf8199356352672 P 68f343adef5749a1beb28b86312e8547: Deleting consensus metadata
I20260810 01:39:28.959318 13282 catalog_manager.cc:4841] TS f8e63c74d7fe44bdb2c8d076d472da96 (127.24.205.131:38295): tablet 06e13ef454024e3badf8199356352672 (table test-table [id=12a9f221b43647738b0ae7822354a0a7]) successfully deleted
I20260810 01:39:28.960619 13285 catalog_manager.cc:4841] TS 68f343adef5749a1beb28b86312e8547 (127.24.205.130:36597): tablet 06e13ef454024e3badf8199356352672 (table test-table [id=12a9f221b43647738b0ae7822354a0a7]) successfully deleted
W20260810 01:39:28.961541 13286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:44603 (error 108)
I20260810 01:39:28.962515 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 13638
I20260810 01:39:28.985070 14233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:28.962328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:44603 (local address 127.0.0.1:46204)
0810 01:39:28.962587 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:28.984912 (+ 22325us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:44603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":67,"threads_started":1}
W20260810 01:39:28.985297 13286 catalog_manager.cc:4584] TS 97705d5867394288bdae3a57eca298c6 (127.24.205.129:44603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 06e13ef454024e3badf8199356352672: Network error: Client connection negotiation failed: client connection to 127.24.205.129:44603: connect: Connection refused (error 111)
I20260810 01:39:28.990888 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 13873
I20260810 01:39:29.002811 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 13256
I20260810 01:39:29.022847 25398 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 01:39:29.367918 25398 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 01:39:29.368045 25398 mini_ranger.cc:66] Stopping Ranger...
I20260810 01:39:29.713788 25398 mini_ranger.cc:68] Stopped Ranger
2026-08-10 01:39:29.714 UTC [11656] LOG: received smart shutdown request
2026-08-10 01:39:29.718 UTC [11656] LOG: background worker "logical replication launcher" (PID 11669) exited with exit code 1
2026-08-10 01:39:29.718 UTC [11662] LOG: shutting down
2026-08-10 01:39:29.893 UTC [11656] LOG: database system is shut down
2026-08-10T01:39:29Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51797 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:39:30 dist-test-slave-t3q3 krb5kdc[14249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:39:30 dist-test-slave-t3q3 krb5kdc[14249](info): set up 2 sockets
Aug 10 01:39:30 dist-test-slave-t3q3 krb5kdc[14249](info): commencing operation
krb5kdc: starting...
W20260810 01:39:31.299582 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:39:31 dist-test-slave-t3q3 krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:39:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:39:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:39:31.435259 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41569
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41569,127.24.205.189:34103,127.24.205.188:38291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:31.550071 14272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:31.550405 14272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:31.550493 14272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:31.554582 14272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:31.554687 14272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:31.554729 14272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:31.554786 14272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:31.554841 14272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:31.560214 14272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41569,127.24.205.189:34103,127.24.205.188:38291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:31.561348 14272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:31.562418 14272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:31.571307 14282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:31.571374 14284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:31.571465 14288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:31.571337 14272 server_base.cc:1034] running on GCE node
I20260810 01:39:31.572317 14272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:31.573514 14272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:31.574719 14272 hybrid_clock.cc:648] HybridClock initialized: now 1786325971574655 us; error 78 us; skew 500 ppm
Aug 10 01:39:31 dist-test-slave-t3q3 krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:31.577848 14272 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:31.578740 14272 webserver.cc:460] Webserver started at http://127.24.205.190:39875/ using document root <none> and password file <none>
I20260810 01:39:31.579278 14272 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:31.579339 14272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:31.579510 14272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:31.581640 14272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "a7b625ed8ab14c5a9f87491b0f7bc818"
format_stamp: "Formatted at 2026-08-10 01:39:31 on dist-test-slave-t3q3"
server_key: "afd637abdb9264053b8c94fd59bd889f"
server_key_iv: "bf6b9a7097ccaccf7129326d4cb0b136"
server_key_version: "encryptionkey@0"
I20260810 01:39:31.582216 14272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "a7b625ed8ab14c5a9f87491b0f7bc818"
format_stamp: "Formatted at 2026-08-10 01:39:31 on dist-test-slave-t3q3"
server_key: "afd637abdb9264053b8c94fd59bd889f"
server_key_iv: "bf6b9a7097ccaccf7129326d4cb0b136"
server_key_version: "encryptionkey@0"
I20260810 01:39:31.586117 14272 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:39:31.588626 14301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:31.589999 14272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:31.590123 14272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "a7b625ed8ab14c5a9f87491b0f7bc818"
format_stamp: "Formatted at 2026-08-10 01:39:31 on dist-test-slave-t3q3"
server_key: "afd637abdb9264053b8c94fd59bd889f"
server_key_iv: "bf6b9a7097ccaccf7129326d4cb0b136"
server_key_version: "encryptionkey@0"
I20260810 01:39:31.590217 14272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:31.607640 14272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:31.611084 14272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:31.611258 14272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:31.618743 14272 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:41569
I20260810 01:39:31.619089 14387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:41569 every 8 connection(s)
I20260810 01:39:31.619810 14272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:31.622804 14389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:31.623095 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 14272
I20260810 01:39:31.623206 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:39:31.623446 25398 external_mini_cluster.cc:1428] Setting key 85fc1d81f1b84e2f11a6bed77397a2b5
I20260810 01:39:31.627574 14389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.205.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.189@KRBTEST.COM" created.
Aug 10 01:39:31 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:31.644362 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.630187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41569 (local address 127.0.0.1:51890)
0810 01:39:31.630864 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.630916 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:31.631837 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:31.632768 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:31.632772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:31.633135 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:31.633520 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.633537 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.634842 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.634844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.635613 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.635623 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.636562 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.636570 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.636780 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.637453 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:31.637469 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:31.639012 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:31.641108 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.641120 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.641130 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.641379 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.641722 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.641725 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.641727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.641844 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.642457 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:31.642463 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:31.642607 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 01:39:31.642786 (+ 179us) client_negotiation.cc:240] Negotiation successful
0810 01:39:31.643273 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":188,"spinlock_wait_cycles":47360,"thread_start_us":162,"threads_started":1}
I20260810 01:39:31.644362 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.630187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51890 (local address 127.24.205.190:41569)
0810 01:39:31.630742 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:31.630765 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:31.631053 (+ 288us) server_negotiation.cc:407] Connection header received
0810 01:39:31.632229 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:31.632238 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:31.632511 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:31.632749 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:31.633699 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.634699 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.635728 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.636350 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.636544 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.639242 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:31.639248 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:31.639259 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:31.639279 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:31.640996 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.641495 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.641511 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.641512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.641614 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.641945 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.641948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.641950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.642332 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:31.642474 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:31.642848 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 01:39:31.643210 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":368,"thread_start_us":158,"threads_started":1}
I20260810 01:39:31.646960 14389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:31.647909 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.647476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60108)
0810 01:39:31.647703 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.647806 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260810 01:39:31.648180 14307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
I20260810 01:39:31.649133 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.648920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60120)
0810 01:39:31.649022 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.649077 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 01:39:31.649319 14389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:34103: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab.
Entry for principal kudu/127.24.205.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab.
I20260810 01:39:31.655759 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:34103
--webserver_interface=127.24.205.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab
--principal=kudu/127.24.205.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41569,127.24.205.189:34103,127.24.205.188:38291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:39:31.698623 14389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } attempt: 1
I20260810 01:39:31.699579 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.699218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60136)
0810 01:39:31.699394 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.699473 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260810 01:39:31.700438 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.700199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60150)
0810 01:39:31.700318 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.700376 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 01:39:31.700582 14389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:34103: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
I20260810 01:39:31.768747 14389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } attempt: 2
I20260810 01:39:31.769690 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.769314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60166)
0810 01:39:31.769505 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.769583 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 01:39:31.770526 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.770271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60180)
0810 01:39:31.770402 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.770460 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 01:39:31.770689 14389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:34103: Network error: Client connection negotiation failed: client connection to 127.24.205.189:34103: connect: Connection refused (error 111)
W20260810 01:39:31.777803 14401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:31.778076 14401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:31.778126 14401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:31.782148 14401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:31.782208 14401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:31.782228 14401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:31.782245 14401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:31.782261 14401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:31.788008 14401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41569,127.24.205.189:34103,127.24.205.188:38291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab
--principal=kudu/127.24.205.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:34103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.205.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:31.789119 14401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:31.790094 14401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:31.798623 14415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:31.798619 14410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:31.798794 14401 server_base.cc:1034] running on GCE node
W20260810 01:39:31.798617 14412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:31.799582 14401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:31.800752 14401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:31.801944 14401 hybrid_clock.cc:648] HybridClock initialized: now 1786325971801907 us; error 50 us; skew 500 ppm
Aug 10 01:39:31 dist-test-slave-t3q3 krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:31.807808 14401 init.cc:377] Logged in from keytab as kudu/127.24.205.189@KRBTEST.COM (short username kudu)
I20260810 01:39:31.808867 14401 webserver.cc:460] Webserver started at http://127.24.205.189:39115/ using document root <none> and password file <none>
I20260810 01:39:31.809450 14401 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:31.809547 14401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:31.809783 14401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:31.811843 14401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data/instance:
uuid: "6af1717fb9fa44da9da3dc5b9630e402"
format_stamp: "Formatted at 2026-08-10 01:39:31 on dist-test-slave-t3q3"
server_key: "c581902f0d33d25c03bfadbee69681dc"
server_key_iv: "dca8fa9ccf86446540dc4771bd77100b"
server_key_version: "encryptionkey@0"
I20260810 01:39:31.812489 14401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/wal/instance:
uuid: "6af1717fb9fa44da9da3dc5b9630e402"
format_stamp: "Formatted at 2026-08-10 01:39:31 on dist-test-slave-t3q3"
server_key: "c581902f0d33d25c03bfadbee69681dc"
server_key_iv: "dca8fa9ccf86446540dc4771bd77100b"
server_key_version: "encryptionkey@0"
I20260810 01:39:31.816282 14401 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:39:31.818886 14427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:31.820250 14401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:31.820393 14401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/wal
uuid: "6af1717fb9fa44da9da3dc5b9630e402"
format_stamp: "Formatted at 2026-08-10 01:39:31 on dist-test-slave-t3q3"
server_key: "c581902f0d33d25c03bfadbee69681dc"
server_key_iv: "dca8fa9ccf86446540dc4771bd77100b"
server_key_version: "encryptionkey@0"
I20260810 01:39:31.820511 14401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:31.842571 14401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:31.846098 14401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:31.846323 14401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:31.854243 14401 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.189:34103
I20260810 01:39:31.854583 14519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.189:34103 every 8 connection(s)
I20260810 01:39:31.855376 14401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
I20260810 01:39:31.858457 14521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:31.861889 14389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } attempt: 3
I20260810 01:39:31.862764 14521 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:31.864825 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 14401
I20260810 01:39:31.864969 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-1/wal/instance
I20260810 01:39:31.865348 25398 external_mini_cluster.cc:1428] Setting key efabba052719f87629958794ccbcabf6
Aug 10 01:39:31 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
Aug 10 01:39:31 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.188@KRBTEST.COM; defaulting to no policy
I20260810 01:39:31.877287 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.862551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60184)
0810 01:39:31.862779 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.862799 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:31.862901 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:31.865463 (+ 2562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:31.865467 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:31.865699 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:31.865878 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.865886 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.868123 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.868127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.868945 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.868956 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.869893 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.869897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.870000 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.870694 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:31.870711 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:31.872419 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:31.874876 (+ 2457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.874879 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.874881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.875258 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.875718 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.875721 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.875724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.875825 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.876668 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:31.876671 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:31.876763 (+ 92us) client_negotiation.cc:769] Sending connection context
0810 01:39:31.876876 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 01:39:31.877087 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260810 01:39:31.878270 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.865051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.24.205.190:41569)
0810 01:39:31.865169 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:31.865173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:31.865672 (+ 499us) server_negotiation.cc:407] Connection header received
0810 01:39:31.865873 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:31.865876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:31.865920 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:31.865975 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:31.866991 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.867733 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.869222 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.869464 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.869591 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.873645 (+ 4054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:31.873651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:31.873655 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:31.873684 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:31.875410 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.875970 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.875973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.875975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.876104 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.876383 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.876387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.876389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.876580 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:31.876691 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:31.877995 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0810 01:39:31.878108 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:39:31.878479 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.863249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60184 (local address 127.24.205.189:34103)
0810 01:39:31.863723 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:31.863748 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:31.863799 (+ 51us) server_negotiation.cc:407] Connection header received
0810 01:39:31.864675 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:31.864695 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:31.865123 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:31.866120 (+ 997us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:31.866552 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.867960 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.869087 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.869759 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.869889 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.872584 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:31.872590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:31.872602 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:31.872624 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:31.874743 (+ 2119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.875401 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.875412 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.875420 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.875599 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.875939 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.875942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.875944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.876554 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:31.876673 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:31.877036 (+ 363us) server_negotiation.cc:299] Negotiation successful
0810 01:39:31.877321 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":310,"spinlock_wait_cycles":8576,"thread_start_us":115,"threads_started":1}
I20260810 01:39:31.878479 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.865031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41569 (local address 127.0.0.1:51900)
0810 01:39:31.865527 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.865583 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:31.865761 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:31.866142 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:31.866147 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:31.866588 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:31.866819 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.866832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.867859 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.867864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.869104 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.869113 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.869625 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.869630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.869795 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.870511 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:31.870548 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:31.873420 (+ 2872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:31.875519 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.875528 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.875535 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.875850 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.876191 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.876195 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.876197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.876288 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.876746 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:31.876754 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:31.876927 (+ 173us) client_negotiation.cc:769] Sending connection context
0810 01:39:31.877638 (+ 711us) client_negotiation.cc:240] Negotiation successful
0810 01:39:31.877824 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":189,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.188@KRBTEST.COM" created.
I20260810 01:39:31.880497 14521 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:31.881362 14389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:31.882130 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.881853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:46986)
0810 01:39:31.881993 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.882064 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 01:39:31.882982 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.882722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:46988)
0810 01:39:31.882889 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.882930 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260810 01:39:31.883162 14389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:38291: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Aug 10 01:39:31 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
I20260810 01:39:31.889211 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.881008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60198)
0810 01:39:31.881134 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.881150 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:31.881235 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:31.881567 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:31.881570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:31.881743 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:31.881842 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.881847 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.882772 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.882776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.883464 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:31.883474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.883932 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.883936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:31.884100 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.884606 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:31.884617 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:31.886037 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:31.887711 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.887718 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.887720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.887908 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.888230 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:31.888234 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:31.888236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:31.888318 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:31.888684 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:31.888687 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:31.888770 (+ 83us) client_negotiation.cc:769] Sending connection context
0810 01:39:31.888888 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 01:39:31.889025 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":17}
I20260810 01:39:31.889211 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.881174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60198 (local address 127.24.205.189:34103)
0810 01:39:31.881289 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:31.881294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:31.881310 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:39:31.881349 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:31.881354 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:31.881401 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:31.881486 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:31.881979 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.882659 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.883581 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:31.883827 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:31.883935 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:31.886203 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:31.886207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:31.886209 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:31.886238 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:31.887602 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.888002 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.888008 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.888010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.888132 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:31.888404 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:31.888409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:31.888411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:31.888590 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:31.888697 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:31.888932 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 01:39:31.889077 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":76,"server-negotiator.queue_time_us":40}
I20260810 01:39:31.890182 14521 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:31.890920 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.890611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:46990)
0810 01:39:31.890752 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.890863 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 01:39:31.891624 14431 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
I20260810 01:39:31.892582 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.892367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47006)
0810 01:39:31.892469 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.892514 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 01:39:31.892738 14521 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:38291: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab.
Entry for principal kudu/127.24.205.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab.
I20260810 01:39:31.898703 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:38291
--webserver_interface=127.24.205.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab
--principal=kudu/127.24.205.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41569,127.24.205.189:34103,127.24.205.188:38291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:39:31.914415 14389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } attempt: 1
I20260810 01:39:31.915303 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.914999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47012)
0810 01:39:31.915162 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.915224 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260810 01:39:31.916150 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.915891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47016)
0810 01:39:31.915992 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.916038 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 01:39:31.916347 14389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:38291: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
I20260810 01:39:31.942044 14521 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } attempt: 1
I20260810 01:39:31.942979 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.942647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47030)
0810 01:39:31.942827 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.942900 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 01:39:31.943934 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.943632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47036)
0810 01:39:31.943752 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.943865 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 01:39:31.944132 14521 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:38291: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
I20260810 01:39:31.991521 14389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } attempt: 2
I20260810 01:39:31.992460 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.992152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47040)
0810 01:39:31.992308 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.992382 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 01:39:31.993274 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:31.993056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47048)
0810 01:39:31.993162 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:31.993212 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 01:39:31.993432 14389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:38291: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
I20260810 01:39:32.012302 14521 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } attempt: 2
I20260810 01:39:32.013217 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.012890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47064)
0810 01:39:32.013051 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.013140 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 01:39:32.014164 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.013884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47074)
0810 01:39:32.014043 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.014092 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260810 01:39:32.014319 14521 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:38291: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
W20260810 01:39:32.018985 14531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:32.019276 14531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:32.019358 14531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:32.023651 14531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:32.023710 14531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:32.023729 14531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:32.023779 14531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:32.023809 14531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:32.029572 14531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41569,127.24.205.189:34103,127.24.205.188:38291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab
--principal=kudu/127.24.205.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:38291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.205.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:32.030699 14531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:32.031765 14531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:32.040827 14546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:32.040925 14549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:32.040827 14544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:32.041040 14531 server_base.cc:1034] running on GCE node
I20260810 01:39:32.041816 14531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:32.042989 14531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:32.044181 14531 hybrid_clock.cc:648] HybridClock initialized: now 1786325972044156 us; error 27 us; skew 500 ppm
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325972, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:32.047304 14531 init.cc:377] Logged in from keytab as kudu/127.24.205.188@KRBTEST.COM (short username kudu)
I20260810 01:39:32.048357 14531 webserver.cc:460] Webserver started at http://127.24.205.188:43881/ using document root <none> and password file <none>
I20260810 01:39:32.048951 14531 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:32.049015 14531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:32.049245 14531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:32.051393 14531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data/instance:
uuid: "3b5930e1aae7465ea64111a95087c023"
format_stamp: "Formatted at 2026-08-10 01:39:32 on dist-test-slave-t3q3"
server_key: "b79065b5354b074050f0e484a177b309"
server_key_iv: "1329928ec9e6d7cc0e625100b563c6dd"
server_key_version: "encryptionkey@0"
I20260810 01:39:32.052006 14531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/wal/instance:
uuid: "3b5930e1aae7465ea64111a95087c023"
format_stamp: "Formatted at 2026-08-10 01:39:32 on dist-test-slave-t3q3"
server_key: "b79065b5354b074050f0e484a177b309"
server_key_iv: "1329928ec9e6d7cc0e625100b563c6dd"
server_key_version: "encryptionkey@0"
I20260810 01:39:32.056228 14531 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:39:32.058918 14558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:32.060439 14531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:32.060596 14531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/wal
uuid: "3b5930e1aae7465ea64111a95087c023"
format_stamp: "Formatted at 2026-08-10 01:39:32 on dist-test-slave-t3q3"
server_key: "b79065b5354b074050f0e484a177b309"
server_key_iv: "1329928ec9e6d7cc0e625100b563c6dd"
server_key_version: "encryptionkey@0"
I20260810 01:39:32.060722 14531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:32.083578 14531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:32.087321 14531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:32.087570 14531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:32.092571 14389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } attempt: 3
I20260810 01:39:32.093506 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.093149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47082)
0810 01:39:32.093324 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.093403 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 01:39:32.094386 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.094111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47096)
0810 01:39:32.094227 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.094307 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 01:39:32.094568 14389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:38291: Network error: Client connection negotiation failed: client connection to 127.24.205.188:38291: connect: Connection refused (error 111)
I20260810 01:39:32.095521 14531 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.188:38291
I20260810 01:39:32.095830 14642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.188:38291 every 8 connection(s)
I20260810 01:39:32.096634 14531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
I20260810 01:39:32.099684 14643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:32.103600 14643 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:32.105536 14521 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } attempt: 3
I20260810 01:39:32.106819 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 14531
I20260810 01:39:32.106959 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786325801109519-25398-0/minicluster-data/master-2/wal/instance
I20260810 01:39:32.107220 25398 external_mini_cluster.cc:1428] Setting key 9dba4f9f1f612d6a7adaceae8b5d9923
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325972, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
I20260810 01:39:32.118912 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.105982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47102)
0810 01:39:32.106161 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.106177 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:32.106286 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:32.108028 (+ 1742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:32.108032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:32.108272 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:32.108412 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.108421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.110037 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.110041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.110710 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.110724 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.111562 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.111566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.111659 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.112332 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:32.112344 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:32.113903 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:32.116776 (+ 2873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.116783 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.116788 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.117066 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.117466 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.117470 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.117473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.117586 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.118315 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:32.118321 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:32.118441 (+ 120us) client_negotiation.cc:769] Sending connection context
0810 01:39:32.118578 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 01:39:32.118733 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260810 01:39:32.118912 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.105657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51916 (local address 127.24.205.190:41569)
0810 01:39:32.105803 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.105813 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.108274 (+ 2461us) server_negotiation.cc:407] Connection header received
0810 01:39:32.108330 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.108333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.108380 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.108457 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.109407 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.110038 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.111246 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.111556 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.111656 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.115060 (+ 3404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.115063 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.115065 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.115113 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.116683 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.117328 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.117331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.117333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.117423 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.117787 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.117790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.117792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.118024 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.118101 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.118646 (+ 545us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.118765 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:39:32.120128 14647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.106132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47102 (local address 127.24.205.188:38291)
0810 01:39:32.106654 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.106669 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.106701 (+ 32us) server_negotiation.cc:407] Connection header received
0810 01:39:32.107563 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.107586 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.107836 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.108014 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.108525 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.109911 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.110837 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.111429 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.111584 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.114050 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.114058 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.114072 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.114098 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.116643 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.117208 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.117215 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.117217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.117351 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.117700 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.117706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.117711 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.118204 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.118327 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.119214 (+ 887us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.119324 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":395,"spinlock_wait_cycles":6528,"thread_start_us":150,"threads_started":1}
I20260810 01:39:32.120172 14652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.108085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47104 (local address 127.24.205.188:38291)
0810 01:39:32.108690 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.108696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.108706 (+ 10us) server_negotiation.cc:407] Connection header received
0810 01:39:32.108735 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.108737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.108767 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.108868 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.109656 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.110397 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.111348 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.111731 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.111848 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.115409 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.115412 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.115415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.115439 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.117788 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.118193 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.118198 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.118200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.118287 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.118672 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.118675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.118677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.118871 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.119809 (+ 938us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.119888 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.119998 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":550,"thread_start_us":115,"threads_started":1}
I20260810 01:39:32.120127 14646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.106132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41569 (local address 127.0.0.1:51916)
0810 01:39:32.107414 (+ 1282us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.107468 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:32.107762 (+ 294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:32.108611 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:32.108617 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:32.109055 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:32.109242 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.109255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.110163 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.110167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.111119 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.111129 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.111835 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.111844 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.112020 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.112716 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:32.112740 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:32.114896 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:32.116844 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.116855 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.116868 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.117211 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.117535 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.117537 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.117538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.117670 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.118189 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:32.118194 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:32.118344 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 01:39:32.118567 (+ 223us) client_negotiation.cc:240] Negotiation successful
0810 01:39:32.118905 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":23,"thread_start_us":148,"threads_started":1}
I20260810 01:39:32.122159 14643 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:32.125231 14521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402: Bootstrap starting.
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325972, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
I20260810 01:39:32.127926 14521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:32.128808 14521 log.cc:824] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:32.131244 14521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402: No bootstrap required, opened a new log
I20260810 01:39:32.132335 14646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.122715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:34103 (local address 127.0.0.1:60204)
0810 01:39:32.122974 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.122988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:32.123103 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:32.123356 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:32.123359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:32.123557 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:32.123677 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.123684 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.124788 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.124791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.125582 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.125593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.126145 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.126152 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.126249 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.126741 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:32.126756 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:32.128389 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:32.130527 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.130533 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.130538 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.130789 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.131094 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.131100 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.131104 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.131197 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.131766 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:32.131772 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:32.131875 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 01:39:32.131982 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 01:39:32.132172 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195}
I20260810 01:39:32.132455 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.122783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60204 (local address 127.24.205.189:34103)
0810 01:39:32.122891 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.122896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.123039 (+ 143us) server_negotiation.cc:407] Connection header received
0810 01:39:32.123192 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.123195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.123241 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.123316 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.123810 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.124641 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.125707 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.126032 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.126139 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.128545 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.128549 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.128552 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.128578 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.130392 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.130882 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.130885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.130887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.130981 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.131315 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.131388 (+ 73us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.131389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.131651 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.131759 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.132198 (+ 439us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.132307 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 01:39:32.133322 14643 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:39:32.134196 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.122939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51932 (local address 127.24.205.190:41569)
0810 01:39:32.123062 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.123067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.123119 (+ 52us) server_negotiation.cc:407] Connection header received
0810 01:39:32.123257 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.123262 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.123312 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.123376 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.124290 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.125007 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.126169 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.126834 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.126921 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.129705 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.129712 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.129716 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.129741 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.131487 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.131974 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.131978 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.131980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.132102 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.133047 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.133051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.133053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.133281 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.133499 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.133915 (+ 416us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.134040 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:39:32.135672 14521 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.135910 14521 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:32.135967 14521 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af1717fb9fa44da9da3dc5b9630e402, State: Initialized, Role: FOLLOWER
I20260810 01:39:32.136554 14521 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.137073 14656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.137555 14656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:39:32.138007 14521 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325972, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
I20260810 01:39:32.142619 14646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.133822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47106)
0810 01:39:32.133958 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.133970 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:32.134049 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:32.134255 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:32.134258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:32.134413 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:32.134471 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.134475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.135471 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.135474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.136274 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.136284 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.136992 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.136999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.137076 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.137503 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:32.137516 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:32.138901 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:32.140963 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.140966 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.140968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.141213 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.141496 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.141499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.141503 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.141590 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.142086 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:32.142092 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:32.142180 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 01:39:32.142282 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 01:39:32.142410 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260810 01:39:32.143275 14647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.133846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47106 (local address 127.24.205.188:38291)
0810 01:39:32.133940 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.133944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.134012 (+ 68us) server_negotiation.cc:407] Connection header received
0810 01:39:32.134117 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.134121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.134155 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.134245 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.134602 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.135357 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.136389 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.136792 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.136889 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.139010 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.139013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.139015 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.139034 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.140846 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.141317 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.141320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.141322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.141395 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.141678 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.141681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.141682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.141947 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.142049 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.142952 (+ 903us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.143066 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 01:39:32.144773 14677 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:39:32.144905 14677 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:39:32.142213 14401 master_runner.cc:186] Error getting master registration for 127.24.205.190:41569: OK, instance_id { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" instance_seqno: 1786325971616735 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:39:32.145614 14401 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:39:32.146445 14643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: Bootstrap starting.
I20260810 01:39:32.149181 14643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:32.150102 14643 log.cc:824] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:32.150704 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.135810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.24.205.189:34103)
0810 01:39:32.135906 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.135909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.135925 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:39:32.136097 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.136099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.136140 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.136212 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.137028 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.137739 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.138884 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.139240 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.139314 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.142298 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.142302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.142305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.142327 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.148884 (+ 6557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.149414 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.149418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.149420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.149508 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.149809 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.149813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.149815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.150001 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.150286 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.150424 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.150542 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:39:32.152716 14643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: No bootstrap required, opened a new log
I20260810 01:39:32.154349 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:39:32.157222 14643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.157802 14643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:32.157866 14643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b5930e1aae7465ea64111a95087c023, State: Initialized, Role: FOLLOWER
I20260810 01:39:32.159192 14643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.160547 14643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:32.168133 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.156712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.24.205.190:41569)
0810 01:39:32.156844 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.156850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.157088 (+ 238us) server_negotiation.cc:407] Connection header received
0810 01:39:32.157566 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.157569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.157612 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.157662 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.158719 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.159494 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.160994 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.161325 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.161399 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.163826 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.163830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.163833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.163858 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.165734 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.166270 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.166276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.166281 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.166377 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.166716 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.166720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.166722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.166997 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.167121 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.167783 (+ 662us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.167922 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:39:32.168355 14647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.156817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47120 (local address 127.24.205.188:38291)
0810 01:39:32.156917 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.156921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.157388 (+ 467us) server_negotiation.cc:407] Connection header received
0810 01:39:32.157565 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.157568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.157612 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.157662 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.158705 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.159495 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.160986 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.161325 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.161399 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.163826 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.163830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.163833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.163858 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.166404 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.166890 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.166896 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.166900 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.166983 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.167312 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.167316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.167320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.167550 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.167684 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.168050 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.168189 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:39:32.169829 14694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.169975 14694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:39:32.166795 14531 master_runner.cc:186] Error getting master registration for 127.24.205.190:41569: OK, instance_id { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" instance_seqno: 1786325971616735 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:39:32.170961 14531 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:39:32.173995 14714 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:39:32.174078 14714 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:39:32.175829 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.156462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60226 (local address 127.24.205.189:34103)
0810 01:39:32.156567 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.156571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.157304 (+ 733us) server_negotiation.cc:407] Connection header received
0810 01:39:32.157434 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.157438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.157484 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.157570 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.162609 (+ 5039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.163364 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.164564 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.164896 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.164970 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.172160 (+ 7190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.172164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.172167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.172197 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.173892 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.174413 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.174417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.174418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.174527 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.174846 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.174850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.174852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.175096 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.175238 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.175527 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.175661 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:39:32.258730 14389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } attempt: 4
Aug 10 01:39:32 dist-test-slave-t3q3 krb5kdc[14249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325971, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
I20260810 01:39:32.269443 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.259238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:38291 (local address 127.0.0.1:47126)
0810 01:39:32.259429 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:32.259445 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:32.259529 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:32.259809 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:32.259812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:32.260036 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:32.260192 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.260199 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.261282 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.261286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.262210 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:32.262222 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.262952 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.262956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:32.263043 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.263707 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:32.263721 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:32.265584 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:32.267678 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.267681 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.267684 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.267943 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.268304 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:32.268307 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:32.268309 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:32.268408 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:32.268879 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:32.268882 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:32.268991 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 01:39:32.269112 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 01:39:32.269270 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260810 01:39:32.269495 14647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:32.259368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47126 (local address 127.24.205.188:38291)
0810 01:39:32.259508 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:32.259512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:32.259529 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:39:32.259619 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:32.259625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:32.259673 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:32.259775 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:32.260345 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.261155 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.262359 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:32.262713 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:32.262809 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:32.265744 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:32.265748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:32.265751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:32.265781 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:32.267550 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.268094 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.268098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.268100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.268196 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:32.268521 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:32.268524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:32.268526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:32.268762 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:32.268873 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:32.269192 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 01:39:32.269324 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 01:39:32.273484 14389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: Bootstrap starting.
I20260810 01:39:32.276388 14389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:32.277305 14389 log.cc:824] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:32.280825 14389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: No bootstrap required, opened a new log
I20260810 01:39:32.285037 14389 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.285316 14389 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:32.285382 14389 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7b625ed8ab14c5a9f87491b0f7bc818, State: Initialized, Role: FOLLOWER
I20260810 01:39:32.285879 14389 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.286451 14717 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.286671 14717 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:39:32.287294 14389 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 01:39:32.293758 14737 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:39:32.293910 14737 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:39:32.296979 14272 master_runner.cc:263] No leader master found from master a7b625ed8ab14c5a9f87491b0f7bc818
I20260810 01:39:32.297068 14272 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:39:32.339232 14566 tablet.cc:2369] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:39:32.348102 14435 tablet.cc:2369] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:39:32.363153 14312 tablet.cc:2369] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:39:32.540908 14656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:32.541162 14656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.542169 14656 leader_election.cc:288] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7b625ed8ab14c5a9f87491b0f7bc818 (127.24.205.190:41569), 3b5930e1aae7465ea64111a95087c023 (127.24.205.188:38291)
I20260810 01:39:32.542833 14597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6af1717fb9fa44da9da3dc5b9630e402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b5930e1aae7465ea64111a95087c023" is_pre_election: true
I20260810 01:39:32.542860 14346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6af1717fb9fa44da9da3dc5b9630e402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" is_pre_election: true
I20260810 01:39:32.543174 14597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af1717fb9fa44da9da3dc5b9630e402 in term 0.
I20260810 01:39:32.543238 14346 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af1717fb9fa44da9da3dc5b9630e402 in term 0.
I20260810 01:39:32.543682 14431 leader_election.cc:302] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b5930e1aae7465ea64111a95087c023, 6af1717fb9fa44da9da3dc5b9630e402; no voters:
I20260810 01:39:32.543998 14656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:39:32.544121 14656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:39:32.544181 14656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:32.545307 14656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.545693 14656 leader_election.cc:288] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [CANDIDATE]: Term 1 election: Requested vote from peers a7b625ed8ab14c5a9f87491b0f7bc818 (127.24.205.190:41569), 3b5930e1aae7465ea64111a95087c023 (127.24.205.188:38291)
I20260810 01:39:32.546041 14346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6af1717fb9fa44da9da3dc5b9630e402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818"
I20260810 01:39:32.546061 14597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6af1717fb9fa44da9da3dc5b9630e402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b5930e1aae7465ea64111a95087c023"
I20260810 01:39:32.546172 14346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:32.546172 14597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:32.547432 14346 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af1717fb9fa44da9da3dc5b9630e402 in term 1.
I20260810 01:39:32.547432 14597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af1717fb9fa44da9da3dc5b9630e402 in term 1.
I20260810 01:39:32.547745 14429 leader_election.cc:302] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3b5930e1aae7465ea64111a95087c023, 6af1717fb9fa44da9da3dc5b9630e402, a7b625ed8ab14c5a9f87491b0f7bc818; no voters:
I20260810 01:39:32.547955 14656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:32.548204 14656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [term 1 LEADER]: Becoming Leader. State: Replica: 6af1717fb9fa44da9da3dc5b9630e402, State: Running, Role: LEADER
I20260810 01:39:32.548528 14656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } }
I20260810 01:39:32.550534 14740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6af1717fb9fa44da9da3dc5b9630e402. Latest consensus state: current_term: 1 leader_uuid: "6af1717fb9fa44da9da3dc5b9630e402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.550654 14740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:32.551587 14742 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:32.552583 14742 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:32.557299 14346 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [term 1 FOLLOWER]: Refusing update from remote peer 6af1717fb9fa44da9da3dc5b9630e402: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:32.557332 14597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [term 1 FOLLOWER]: Refusing update from remote peer 6af1717fb9fa44da9da3dc5b9630e402: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:32.557940 14656 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:32.558101 14740 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:32.562078 14717 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6af1717fb9fa44da9da3dc5b9630e402. Latest consensus state: current_term: 1 leader_uuid: "6af1717fb9fa44da9da3dc5b9630e402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.562093 14694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6af1717fb9fa44da9da3dc5b9630e402. Latest consensus state: current_term: 1 leader_uuid: "6af1717fb9fa44da9da3dc5b9630e402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.562202 14717 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:39:32.562206 14694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:39:32.564756 14740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6af1717fb9fa44da9da3dc5b9630e402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.564879 14740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:32.565107 14740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6af1717fb9fa44da9da3dc5b9630e402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.565200 14740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:32.565279 14746 mvcc.cc:205] Tried to move back new op lower bound from 7316791183588548608 to 7316791183561498624. Current Snapshot: MvccSnapshot[applied={T|T < 7316791183588548608}]
I20260810 01:39:32.565280 14747 mvcc.cc:205] Tried to move back new op lower bound from 7316791183588548608 to 7316791183561498624. Current Snapshot: MvccSnapshot[applied={T|T < 7316791183588548608}]
I20260810 01:39:32.565418 14694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6af1717fb9fa44da9da3dc5b9630e402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.565512 14694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:39:32.565492 14717 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6af1717fb9fa44da9da3dc5b9630e402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b625ed8ab14c5a9f87491b0f7bc818" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41569 } } peers { permanent_uuid: "6af1717fb9fa44da9da3dc5b9630e402" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 34103 } } peers { permanent_uuid: "3b5930e1aae7465ea64111a95087c023" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 38291 } } }
I20260810 01:39:32.565595 14717 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:39:32.566120 14742 catalog_manager.cc:1347] Generated new cluster ID: bae7741100d74fe58e7f8e92951778bb
I20260810 01:39:32.566179 14742 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:39:32.578029 14742 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:39:32.579190 14742 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:39:32.592705 14742 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6af1717fb9fa44da9da3dc5b9630e402: Generated new TSK 0
I20260810 01:39:32.593549 14742 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:39:33.175408 14714 catalog_manager.cc:1259] Loaded cluster ID: bae7741100d74fe58e7f8e92951778bb
I20260810 01:39:33.175494 14714 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: loading cluster ID for follower catalog manager: success
I20260810 01:39:33.177260 14714 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: acquiring CA information for follower catalog manager: success
I20260810 01:39:33.178485 14714 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3b5930e1aae7465ea64111a95087c023: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:39:33.295368 14737 catalog_manager.cc:1259] Loaded cluster ID: bae7741100d74fe58e7f8e92951778bb
I20260810 01:39:33.295457 14737 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: loading cluster ID for follower catalog manager: success
I20260810 01:39:33.297250 14737 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: acquiring CA information for follower catalog manager: success
I20260810 01:39:33.298442 14737 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a7b625ed8ab14c5a9f87491b0f7bc818: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:39:33.664685 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 14272
I20260810 01:39:33.678789 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 14401
I20260810 01:39:33.689777 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 14531
2026-08-10T01:39:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3674 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:39:33 dist-test-slave-t3q3 krb5kdc[14772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:39:33 dist-test-slave-t3q3 krb5kdc[14772](info): set up 2 sockets
Aug 10 01:39:33 dist-test-slave-t3q3 krb5kdc[14772](info): commencing operation
krb5kdc: starting...
W20260810 01:39:34.962102 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:39:35 dist-test-slave-t3q3 krb5kdc[14772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:39:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:39:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:39:35.093355 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:45213
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:45213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:35.205514 14797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:35.205801 14797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:35.205874 14797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:35.209841 14797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:35.209921 14797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:35.209961 14797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:35.210018 14797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:35.210055 14797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:35.215185 14797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:45213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:45213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:35.216555 14797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:35.217620 14797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:35.226686 14806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:35.226675 14808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:35.226759 14797 server_base.cc:1034] running on GCE node
W20260810 01:39:35.226671 14805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:35.227509 14797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:35.228631 14797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:35.229797 14797 hybrid_clock.cc:648] HybridClock initialized: now 1786325975229766 us; error 44 us; skew 500 ppm
Aug 10 01:39:35 dist-test-slave-t3q3 krb5kdc[14772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325975, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:35.232563 14797 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:35.233592 14797 webserver.cc:460] Webserver started at http://127.24.205.190:42047/ using document root <none> and password file <none>
I20260810 01:39:35.234169 14797 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:35.234229 14797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:35.234473 14797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:35.236603 14797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "8d2ed94ceaf044b39daba30279eed1f3"
format_stamp: "Formatted at 2026-08-10 01:39:35 on dist-test-slave-t3q3"
server_key: "20504609e8b9f7389d1739b99fccffc3"
server_key_iv: "fd5c9fa50895c85a9cffdad90da04937"
server_key_version: "encryptionkey@0"
I20260810 01:39:35.237190 14797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "8d2ed94ceaf044b39daba30279eed1f3"
format_stamp: "Formatted at 2026-08-10 01:39:35 on dist-test-slave-t3q3"
server_key: "20504609e8b9f7389d1739b99fccffc3"
server_key_iv: "fd5c9fa50895c85a9cffdad90da04937"
server_key_version: "encryptionkey@0"
I20260810 01:39:35.241061 14797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:39:35.243523 14817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:35.244925 14797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:39:35.245078 14797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "8d2ed94ceaf044b39daba30279eed1f3"
format_stamp: "Formatted at 2026-08-10 01:39:35 on dist-test-slave-t3q3"
server_key: "20504609e8b9f7389d1739b99fccffc3"
server_key_iv: "fd5c9fa50895c85a9cffdad90da04937"
server_key_version: "encryptionkey@0"
I20260810 01:39:35.245208 14797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:35.271735 14797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:35.275058 14797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:35.275321 14797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:35.282986 14797 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:45213
I20260810 01:39:35.283008 14906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:45213 every 8 connection(s)
I20260810 01:39:35.283977 14797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:35.286903 14907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:35.290088 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 14797
I20260810 01:39:35.290225 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:39:35.290561 25398 external_mini_cluster.cc:1428] Setting key 0a7a6c23c293dd12b73d1393b5e6d5e9
I20260810 01:39:35.294020 14907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3: Bootstrap starting.
I20260810 01:39:35.296679 14907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:35.297550 14907 log.cc:824] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:39:35 dist-test-slave-t3q3 krb5kdc[14772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:35.299657 14907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3: No bootstrap required, opened a new log
I20260810 01:39:35.303975 14907 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d2ed94ceaf044b39daba30279eed1f3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45213 } }
I20260810 01:39:35.304289 14907 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:35.304421 14907 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2ed94ceaf044b39daba30279eed1f3, State: Initialized, Role: FOLLOWER
I20260810 01:39:35.304953 14907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d2ed94ceaf044b39daba30279eed1f3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45213 } }
I20260810 01:39:35.305130 14907 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:39:35.305202 14907 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:39:35.305294 14907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:35.306119 14915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:35.291925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53542 (local address 127.24.205.190:45213)
0810 01:39:35.292403 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:35.292429 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:35.292464 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:39:35.293120 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:35.293144 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:35.293471 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:35.293747 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:35.294705 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:35.295696 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:35.296907 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:35.297371 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:35.297492 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:35.300139 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:35.300146 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:35.300163 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:35.300194 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:35.302764 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:35.303253 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:35.303259 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:35.303265 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:35.303414 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:35.303686 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:35.303690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:35.303691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:35.304232 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:35.304449 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:35.304789 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 01:39:35.305092 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":194,"threads_started":1}
I20260810 01:39:35.306428 14907 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d2ed94ceaf044b39daba30279eed1f3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45213 } }
I20260810 01:39:35.306787 14907 leader_election.cc:302] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d2ed94ceaf044b39daba30279eed1f3; no voters:
I20260810 01:39:35.307174 14907 leader_election.cc:288] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:39:35.307298 14918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:35.307531 14918 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [term 1 LEADER]: Becoming Leader. State: Replica: 8d2ed94ceaf044b39daba30279eed1f3, State: Running, Role: LEADER
I20260810 01:39:35.307921 14918 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d2ed94ceaf044b39daba30279eed1f3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45213 } }
I20260810 01:39:35.308601 14907 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:35.309250 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:39:35.309794 14922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d2ed94ceaf044b39daba30279eed1f3. Latest consensus state: current_term: 1 leader_uuid: "8d2ed94ceaf044b39daba30279eed1f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d2ed94ceaf044b39daba30279eed1f3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45213 } } }
I20260810 01:39:35.309924 14922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:35.310241 14919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d2ed94ceaf044b39daba30279eed1f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d2ed94ceaf044b39daba30279eed1f3" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 45213 } } }
I20260810 01:39:35.310340 14919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:35.310319 14932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:35.313630 14932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:35.318936 14932 catalog_manager.cc:1347] Generated new cluster ID: 9e9be6e6a8d74c3fa0d9b44e84b411d8
I20260810 01:39:35.319002 14932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:39:35.344702 14932 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:39:35.345716 14932 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:39:35.351154 14932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d2ed94ceaf044b39daba30279eed1f3: Generated new TSK 0
I20260810 01:39:35.351979 14932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:39:35.365471 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 14797
2026-08-10T01:39:35Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1674 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:39:35 dist-test-slave-t3q3 krb5kdc[14958](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:39:35 dist-test-slave-t3q3 krb5kdc[14958](info): set up 2 sockets
Aug 10 01:39:35 dist-test-slave-t3q3 krb5kdc[14958](info): commencing operation
krb5kdc: starting...
W20260810 01:39:36.620776 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:39:36 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:39:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:39:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:39:36.757090 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46609
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:46609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:36.870486 14982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:36.870739 14982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:36.870786 14982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:36.874630 14982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:36.874677 14982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:36.874696 14982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:36.874713 14982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:36.874728 14982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:36.879714 14982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:46609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:36.880703 14982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:36.881637 14982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:39:36.890201 14982 server_base.cc:1034] running on GCE node
W20260810 01:39:36.890071 14994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:36.890106 14996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:36.890089 14990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:36.890910 14982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:36.891952 14982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:36.893134 14982 hybrid_clock.cc:648] HybridClock initialized: now 1786325976893113 us; error 32 us; skew 500 ppm
Aug 10 01:39:36 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325976, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:36.900283 14982 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:36.901181 14982 webserver.cc:460] Webserver started at http://127.24.205.190:43657/ using document root <none> and password file <none>
I20260810 01:39:36.901755 14982 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:36.901851 14982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:36.902096 14982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:36.904234 14982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "3f56406ba7604e93b01d8a85ea59d232"
format_stamp: "Formatted at 2026-08-10 01:39:36 on dist-test-slave-t3q3"
server_key: "2ed073032bf0657f564344c780d970ca"
server_key_iv: "c491bb6bc912c7f95d12e2a9f8d67900"
server_key_version: "encryptionkey@0"
I20260810 01:39:36.904829 14982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "3f56406ba7604e93b01d8a85ea59d232"
format_stamp: "Formatted at 2026-08-10 01:39:36 on dist-test-slave-t3q3"
server_key: "2ed073032bf0657f564344c780d970ca"
server_key_iv: "c491bb6bc912c7f95d12e2a9f8d67900"
server_key_version: "encryptionkey@0"
I20260810 01:39:36.908591 14982 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:36.911000 15013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:36.912281 14982 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:39:36.912420 14982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "3f56406ba7604e93b01d8a85ea59d232"
format_stamp: "Formatted at 2026-08-10 01:39:36 on dist-test-slave-t3q3"
server_key: "2ed073032bf0657f564344c780d970ca"
server_key_iv: "c491bb6bc912c7f95d12e2a9f8d67900"
server_key_version: "encryptionkey@0"
I20260810 01:39:36.912529 14982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:36.942951 14982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:36.946731 14982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:36.946962 14982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:36.954425 14982 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:46609
I20260810 01:39:36.954731 15102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:46609 every 8 connection(s)
I20260810 01:39:36.955572 14982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:36.958479 15104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:36.964352 15104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Bootstrap starting.
I20260810 01:39:36.964708 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 14982
I20260810 01:39:36.964859 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:39:36.965193 25398 external_mini_cluster.cc:1428] Setting key 04fa592901da4f557c696eedaaf35ae0
I20260810 01:39:36.967163 15104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:36.967926 15104 log.cc:824] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:36.969897 15104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: No bootstrap required, opened a new log
I20260810 01:39:36.973333 15104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:36.973573 15104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:36.973657 15104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f56406ba7604e93b01d8a85ea59d232, State: Initialized, Role: FOLLOWER
I20260810 01:39:36.974195 15104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
Aug 10 01:39:36 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:36.974359 15104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:39:36.974485 15104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:39:36.974599 15104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:36.975633 15104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:36.976056 15104 leader_election.cc:302] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f56406ba7604e93b01d8a85ea59d232; no voters:
I20260810 01:39:36.976491 15104 leader_election.cc:288] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:39:36.976567 15112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:36.976770 15112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 LEADER]: Becoming Leader. State: Replica: 3f56406ba7604e93b01d8a85ea59d232, State: Running, Role: LEADER
I20260810 01:39:36.977072 15112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:36.977839 15104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:36.978742 15121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f56406ba7604e93b01d8a85ea59d232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } } }
I20260810 01:39:36.978969 15121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:36.979360 15116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f56406ba7604e93b01d8a85ea59d232. Latest consensus state: current_term: 1 leader_uuid: "3f56406ba7604e93b01d8a85ea59d232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } } }
I20260810 01:39:36.979511 15116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:36.980378 15132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:36.982728 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:36.966618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46478 (local address 127.24.205.190:46609)
0810 01:39:36.967100 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:36.967116 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:36.967155 (+ 39us) server_negotiation.cc:407] Connection header received
0810 01:39:36.967882 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:36.967901 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:36.968318 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:36.968668 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:36.969546 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:36.970611 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:36.971522 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:36.972000 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:36.972216 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:36.975026 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:36.975032 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:36.975045 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:36.975081 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:36.978998 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:36.979616 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:36.979624 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:36.979645 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:36.979814 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:36.980424 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:36.980430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:36.980434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:36.980951 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:36.981167 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:36.981469 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 01:39:36.981795 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":154,"threads_started":1}
I20260810 01:39:36.983700 15132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:36.988911 15132 catalog_manager.cc:1347] Generated new cluster ID: a31467d9db134b388ea433f5f8a7916c
I20260810 01:39:36.988977 15132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:39:37.008306 15132 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:39:37.009328 15132 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:39:37.014690 15132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Generated new TSK 0
I20260810 01:39:37.015378 15132 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:39:37.047845 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46609
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:37.163772 15150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:37.164176 15150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:37.164232 15150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:37.168164 15150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:37.168218 15150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:37.168274 15150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:39:37.173425 15150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:37.174512 15150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:37.175508 15150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:37.185623 15161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:37.185609 15159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:37.185606 15157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:37.185894 15150 server_base.cc:1034] running on GCE node
I20260810 01:39:37.186395 15150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:37.187060 15150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:37.188256 15150 hybrid_clock.cc:648] HybridClock initialized: now 1786325977188220 us; error 49 us; skew 500 ppm
Aug 10 01:39:37 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325977, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:37.191148 15150 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:39:37.191979 15150 webserver.cc:460] Webserver started at http://127.24.205.129:33441/ using document root <none> and password file <none>
I20260810 01:39:37.192600 15150 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:37.192662 15150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:37.192836 15150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:37.194859 15150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "cefa6ac152044dee99e5fe3c4b7c619a"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "50d46723bd28828cabaa600be4dea6e7"
server_key_iv: "ed4c5c5de890b31f4088e114d4200738"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.195380 15150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "cefa6ac152044dee99e5fe3c4b7c619a"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "50d46723bd28828cabaa600be4dea6e7"
server_key_iv: "ed4c5c5de890b31f4088e114d4200738"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.199219 15150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:39:37.201715 15174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.202979 15150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:39:37.203075 15150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "cefa6ac152044dee99e5fe3c4b7c619a"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "50d46723bd28828cabaa600be4dea6e7"
server_key_iv: "ed4c5c5de890b31f4088e114d4200738"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.203163 15150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:37.219555 15150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:37.222862 15150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:37.223083 15150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:37.223698 15150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:37.224558 15150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:37.224614 15150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.224682 15150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:37.224713 15150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.240985 15150 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:43511
I20260810 01:39:37.241008 15353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:43511 every 8 connection(s)
I20260810 01:39:37.241909 15150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:39:37.247215 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 15150
I20260810 01:39:37.247381 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:39:37.247753 25398 external_mini_cluster.cc:1428] Setting key 7afe4d099702a8a681804a21cef48ccd
Aug 10 01:39:37 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325977, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:37.257261 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.243736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:57407 (local address 127.24.205.190:46609)
0810 01:39:37.243892 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.243897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.244853 (+ 956us) server_negotiation.cc:407] Connection header received
0810 01:39:37.246181 (+ 1328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.246184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.246231 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.246307 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:37.247578 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.248377 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.249877 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.250279 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.250405 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.253194 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:37.253198 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:37.253200 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:37.253224 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:37.254773 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.255327 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.255330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.255331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.255416 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.255890 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.255894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.255895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.256193 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:37.256286 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.256988 (+ 702us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.257135 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:39:37.258488 15358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.244236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:57407)
0810 01:39:37.244699 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.244743 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.245977 (+ 1234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.246475 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.246481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.246839 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:37.247367 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.247388 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.248529 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.248533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.249743 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.249753 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.250437 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.250440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.250579 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.251195 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:37.251212 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:37.253012 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:37.254894 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:37.254900 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:37.254915 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:37.255231 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:37.255523 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:37.255528 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:37.255533 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:37.255745 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:37.256318 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:37.256329 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:37.256690 (+ 361us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.256943 (+ 253us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.257350 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:39:37.259860 15354 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46609
I20260810 01:39:37.260175 15354 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:37.260710 15354 heartbeater.cc:511] Master 127.24.205.190:46609 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
I20260810 01:39:37.262341 15036 ts_manager.cc:194] Registered new tserver with Master: cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511)
I20260810 01:39:37.263486 15036 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:57407
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:39:37.279263 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46609
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:37.395112 15361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:37.395370 15361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:37.395412 15361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:37.399479 15361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:37.399544 15361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:37.399605 15361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:39:37.404824 15361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:37.405974 15361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:37.407047 15361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:39:37.416690 15361 server_base.cc:1034] running on GCE node
W20260810 01:39:37.416711 15369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:37.416775 15372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:37.416676 15368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:37.417366 15361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:37.417991 15361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:37.419164 15361 hybrid_clock.cc:648] HybridClock initialized: now 1786325977419135 us; error 41 us; skew 500 ppm
Aug 10 01:39:37 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325977, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:37.422152 15361 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:39:37.423040 15361 webserver.cc:460] Webserver started at http://127.24.205.130:35551/ using document root <none> and password file <none>
I20260810 01:39:37.423631 15361 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:37.423697 15361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:37.423916 15361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:37.426009 15361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "ad1372223cdf46268adb3c30eca95f7d"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "982c8bcb8fe5ced9ecc3bc05959cf3b0"
server_key_iv: "118dfa1c57992a84b2665c1478dc72b4"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.426605 15361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "ad1372223cdf46268adb3c30eca95f7d"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "982c8bcb8fe5ced9ecc3bc05959cf3b0"
server_key_iv: "118dfa1c57992a84b2665c1478dc72b4"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.430595 15361 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:39:37.433156 15383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.434410 15361 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:39:37.434558 15361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "ad1372223cdf46268adb3c30eca95f7d"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "982c8bcb8fe5ced9ecc3bc05959cf3b0"
server_key_iv: "118dfa1c57992a84b2665c1478dc72b4"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.434679 15361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:37.475912 15361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:37.479600 15361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:37.479816 15361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:37.480572 15361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:37.481489 15361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:37.481551 15361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.481603 15361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:37.482038 15361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.491321 15361 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36655
I20260810 01:39:37.491343 15580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36655 every 8 connection(s)
I20260810 01:39:37.492344 15361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:39:37.496667 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 15361
I20260810 01:39:37.496810 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:39:37.497099 25398 external_mini_cluster.cc:1428] Setting key b206a1e1a5cfe4f3c6e9962fbfb6d99a
Aug 10 01:39:37 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325977, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:37.507424 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.494226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:50163 (local address 127.24.205.190:46609)
0810 01:39:37.494359 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.494366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.495209 (+ 843us) server_negotiation.cc:407] Connection header received
0810 01:39:37.496666 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.496670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.496727 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.496810 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:37.498172 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.498836 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.500001 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.500301 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.500417 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.503321 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:37.503325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:37.503327 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:37.503351 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:37.504864 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.505550 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.505553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.505554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.505639 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.506132 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.506134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.506136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.506318 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:37.506400 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.507187 (+ 787us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.507296 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:39:37.508603 15585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.494587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:50163)
0810 01:39:37.495056 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.495107 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.496448 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.497019 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.497025 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.497468 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:37.498019 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.498034 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.498973 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.498981 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.499874 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.499883 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.500461 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.500465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.500635 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.501240 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:37.501257 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:37.503126 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:37.504989 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:37.504998 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:37.505015 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:37.505442 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:37.505739 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:37.505745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:37.505750 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:37.505956 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:37.506432 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:37.506440 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:37.506802 (+ 362us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.507050 (+ 248us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.507424 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":114,"threads_started":1}
I20260810 01:39:37.509859 15583 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46609
I20260810 01:39:37.510119 15583 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:37.510622 15583 heartbeater.cc:511] Master 127.24.205.190:46609 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:39:37.511833 15036 ts_manager.cc:194] Registered new tserver with Master: ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655)
I20260810 01:39:37.512490 15036 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:50163
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:39:37.528465 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46609
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:37.642663 15589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:37.642939 15589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:37.643013 15589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:37.647061 15589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:37.647135 15589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:37.647194 15589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:39:37.652498 15589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:37.653616 15589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:37.654667 15589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:37.664618 15600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:37.664690 15595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:37.664829 15589 server_base.cc:1034] running on GCE node
W20260810 01:39:37.664641 15602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:37.665475 15589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:37.666137 15589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:37.667335 15589 hybrid_clock.cc:648] HybridClock initialized: now 1786325977667325 us; error 32 us; skew 500 ppm
Aug 10 01:39:37 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325977, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:37.670272 15589 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:39:37.671098 15589 webserver.cc:460] Webserver started at http://127.24.205.131:41711/ using document root <none> and password file <none>
I20260810 01:39:37.671630 15589 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:37.671690 15589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:37.671855 15589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:37.673950 15589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "b1d431af95f44392be9a7897aa337763"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "ae04fb976647b459871320a82f75badc"
server_key_iv: "b46a38dedb07a611f40484169f87b38d"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.674484 15589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "b1d431af95f44392be9a7897aa337763"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "ae04fb976647b459871320a82f75badc"
server_key_iv: "b46a38dedb07a611f40484169f87b38d"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.678505 15589 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:39:37.681054 15611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.682332 15589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:39:37.682457 15589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "b1d431af95f44392be9a7897aa337763"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "ae04fb976647b459871320a82f75badc"
server_key_iv: "b46a38dedb07a611f40484169f87b38d"
server_key_version: "encryptionkey@0"
I20260810 01:39:37.682569 15589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:37.701481 15589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:37.704624 15589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:37.704833 15589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:37.705498 15589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:37.706341 15589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:37.706389 15589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.706457 15589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:37.706573 15589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:37.715741 15589 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:46353
I20260810 01:39:37.715840 15800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:46353 every 8 connection(s)
I20260810 01:39:37.716810 15589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:39:37.725654 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 15589
I20260810 01:39:37.725821 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:39:37.726101 25398 external_mini_cluster.cc:1428] Setting key 842ed1bd4c6d9e73ad390a82055f90f6
Aug 10 01:39:37 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325977, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:37.731040 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.718683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:33515 (local address 127.24.205.190:46609)
0810 01:39:37.718834 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.718837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.719703 (+ 866us) server_negotiation.cc:407] Connection header received
0810 01:39:37.721129 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.721133 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.721195 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.721276 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:37.722539 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.723089 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.724375 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.724600 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.724689 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.727548 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:37.727552 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:37.727555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:37.727584 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:37.729253 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.729729 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.729732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.729733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.729811 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.730116 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.730118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.730119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.730293 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:37.730369 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.730824 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.730919 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:39:37.731976 15804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.719074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:33515)
0810 01:39:37.719526 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.719570 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.720913 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.721493 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.721501 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.721888 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:37.722389 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.722404 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.723211 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.723213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.724259 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.724269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.724737 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.724739 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.724883 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.725525 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:37.725542 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:37.727376 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:37.729360 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:37.729365 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:37.729377 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:37.729641 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:37.729890 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:37.729893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:37.729894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:37.730026 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:37.730380 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:37.730386 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:37.730619 (+ 233us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.730779 (+ 160us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.731035 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":115,"threads_started":1}
I20260810 01:39:37.733103 15801 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46609
I20260810 01:39:37.733368 15801 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:37.733886 15801 heartbeater.cc:511] Master 127.24.205.190:46609 requested a full tablet report, sending...
I20260810 01:39:37.734925 15036 ts_manager.cc:194] Registered new tserver with Master: b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353)
I20260810 01:39:37.735476 15036 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:33515
I20260810 01:39:37.740283 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:39:37.749523 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.742308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46492 (local address 127.24.205.190:46609)
0810 01:39:37.742448 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.742452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.742641 (+ 189us) server_negotiation.cc:407] Connection header received
0810 01:39:37.742744 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.742746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.742799 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.742935 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:37.743654 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.744253 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.745073 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.745281 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.745356 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.746716 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:37.746719 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:37.746721 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:37.746739 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:37.747948 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.748466 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.748469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.748470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.748547 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:37.748799 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:37.748801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:37.748803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:37.749006 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:37.749109 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.749318 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.749411 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:39:37.752542 15036 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46492:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:39:37.755467 15036 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:39:37.770242 15824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.764187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36655 (local address 127.0.0.1:44508)
0810 01:39:37.764528 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.764580 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.764719 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.765959 (+ 1240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.765965 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.765987 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:37.766143 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.766149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.767545 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.767547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.768780 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.768790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.769683 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.769686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.769803 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.769843 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.769953 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.770085 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":79,"threads_started":1}
I20260810 01:39:37.770253 15834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.764925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44508 (local address 127.24.205.130:36655)
0810 01:39:37.765424 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.765436 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.765464 (+ 28us) server_negotiation.cc:407] Connection header received
0810 01:39:37.765549 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.765558 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.765789 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.765968 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:37.766280 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.767410 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.768923 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.769561 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.769700 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.769841 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.770002 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.770103 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":174,"threads_started":1}
I20260810 01:39:37.770908 15825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.764200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43511 (local address 127.0.0.1:35200)
0810 01:39:37.765729 (+ 1529us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.765745 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.765851 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.766502 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.766504 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.766530 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:37.766761 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.766769 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.768214 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.768218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.769374 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.769384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.770487 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.770490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.770588 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.770610 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.770702 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.770773 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":56,"spinlock_wait_cycles":16768,"thread_start_us":97,"threads_started":1}
I20260810 01:39:37.770962 15826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.764609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35200 (local address 127.24.205.129:43511)
0810 01:39:37.765274 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.765282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.765842 (+ 560us) server_negotiation.cc:407] Connection header received
0810 01:39:37.766003 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.766009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.766196 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.766315 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:37.766893 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.768046 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.769528 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.770366 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.770489 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.770618 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.770735 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.770824 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":108,"threads_started":1}
I20260810 01:39:37.772030 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.764947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:46353 (local address 127.0.0.1:46322)
0810 01:39:37.765424 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.765438 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.765530 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.766503 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.766506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.766533 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:37.766770 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.766776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.768929 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.768932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.770005 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.770014 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.771678 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.771682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.771768 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.771791 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.771841 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.771903 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":115,"spinlock_wait_cycles":3712,"thread_start_us":128,"threads_started":1}
I20260810 01:39:37.772784 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.765330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46322 (local address 127.24.205.131:46353)
0810 01:39:37.766016 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.766033 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.766055 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:39:37.766133 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.766140 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.766352 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.766512 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:37.767604 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.768778 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.770149 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.771512 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.772358 (+ 846us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.772481 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.772550 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.772648 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":138,"threads_started":1}
I20260810 01:39:37.773846 15468 tablet_service.cc:1467] Processing CreateTablet for tablet 056b4ed4e422496f8e729dd387834b66 (DEFAULT_TABLE table=test-table [id=9c1add0b4efb4567883d5f8c9dd1c3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:37.773804 15249 tablet_service.cc:1467] Processing CreateTablet for tablet 056b4ed4e422496f8e729dd387834b66 (DEFAULT_TABLE table=test-table [id=9c1add0b4efb4567883d5f8c9dd1c3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:37.774861 15468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056b4ed4e422496f8e729dd387834b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:37.774887 15249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056b4ed4e422496f8e729dd387834b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:37.775494 15690 tablet_service.cc:1467] Processing CreateTablet for tablet 056b4ed4e422496f8e729dd387834b66 (DEFAULT_TABLE table=test-table [id=9c1add0b4efb4567883d5f8c9dd1c3cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:37.776549 15690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056b4ed4e422496f8e729dd387834b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:37.781636 15837 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Bootstrap starting.
I20260810 01:39:37.783041 15838 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap starting.
I20260810 01:39:37.783905 15839 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Bootstrap starting.
I20260810 01:39:37.784503 15837 tablet_bootstrap.cc:654] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:37.785136 15838 tablet_bootstrap.cc:654] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:37.785502 15837 log.cc:824] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:37.786000 15838 log.cc:824] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:37.786763 15839 tablet_bootstrap.cc:654] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:37.787580 15839 log.cc:824] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:37.787763 15837 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: No bootstrap required, opened a new log
I20260810 01:39:37.787974 15837 ts_tablet_manager.cc:1397] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 01:39:37.789644 15838 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: No bootstrap required, opened a new log
I20260810 01:39:37.789644 15839 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: No bootstrap required, opened a new log
I20260810 01:39:37.789844 15839 ts_tablet_manager.cc:1397] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:39:37.789844 15838 ts_tablet_manager.cc:1397] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 01:39:37.790922 15837 raft_consensus.cc:348] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.791123 15837 raft_consensus.cc:374] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:37.791164 15837 raft_consensus.cc:729] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1372223cdf46268adb3c30eca95f7d, State: Initialized, Role: FOLLOWER
I20260810 01:39:37.791625 15837 consensus_queue.cc:260] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.792346 15583 heartbeater.cc:503] Master 127.24.205.190:46609 was elected leader, sending a full tablet report...
I20260810 01:39:37.792703 15837 ts_tablet_manager.cc:1428] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:39:37.793900 15839 raft_consensus.cc:348] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.794175 15839 raft_consensus.cc:374] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:37.794247 15839 raft_consensus.cc:729] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d431af95f44392be9a7897aa337763, State: Initialized, Role: FOLLOWER
I20260810 01:39:37.794636 15838 raft_consensus.cc:348] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.794759 15839 consensus_queue.cc:260] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.794862 15838 raft_consensus.cc:374] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:37.794919 15838 raft_consensus.cc:729] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa6ac152044dee99e5fe3c4b7c619a, State: Initialized, Role: FOLLOWER
I20260810 01:39:37.795364 15838 consensus_queue.cc:260] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.795724 15801 heartbeater.cc:503] Master 127.24.205.190:46609 was elected leader, sending a full tablet report...
I20260810 01:39:37.795781 15839 ts_tablet_manager.cc:1428] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:39:37.796368 15838 ts_tablet_manager.cc:1428] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:39:37.796686 15354 heartbeater.cc:503] Master 127.24.205.190:46609 was elected leader, sending a full tablet report...
I20260810 01:39:37.916102 15844 raft_consensus.cc:482] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:37.916307 15844 raft_consensus.cc:504] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.917519 15844 leader_election.cc:288] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511), b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353)
I20260810 01:39:37.921252 15585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.917776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:46353 (local address 127.24.205.130:50137)
0810 01:39:37.917896 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.917912 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.918006 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.918373 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.918377 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.918396 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:37.918519 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.918525 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.919278 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.919282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.920118 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.920127 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.920795 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.920799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.920913 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.920938 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.921032 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.921120 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":23}
I20260810 01:39:37.921252 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.918015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:50137 (local address 127.24.205.131:46353)
0810 01:39:37.918157 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.918160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.918173 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:39:37.918220 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.918222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.918261 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.918359 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:37.918649 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.919159 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.920258 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.920668 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.920802 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.920857 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.921051 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.921123 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:39:37.921787 15851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.917776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43511 (local address 127.24.205.130:53421)
0810 01:39:37.918471 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:37.918483 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:37.918604 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:37.918881 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:37.918884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:37.918901 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:37.919033 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.919038 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.919776 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.919780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.920611 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:37.920621 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.921350 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.921353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:37.921452 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.921474 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:39:37.921572 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 01:39:37.921638 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":325,"thread_start_us":171,"threads_started":1}
I20260810 01:39:37.921772 15826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.917846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:53421 (local address 127.24.205.129:43511)
0810 01:39:37.917985 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.917989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.918574 (+ 585us) server_negotiation.cc:407] Connection header received
0810 01:39:37.918725 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.918729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.918780 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.918867 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:37.919157 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.919652 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.920759 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.921206 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.921350 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.921398 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.921590 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.921664 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:39:37.922024 15732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056b4ed4e422496f8e729dd387834b66" candidate_uuid: "ad1372223cdf46268adb3c30eca95f7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d431af95f44392be9a7897aa337763" is_pre_election: true
I20260810 01:39:37.922427 15732 raft_consensus.cc:2454] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1372223cdf46268adb3c30eca95f7d in term 0.
I20260810 01:39:37.922451 15275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056b4ed4e422496f8e729dd387834b66" candidate_uuid: "ad1372223cdf46268adb3c30eca95f7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" is_pre_election: true
I20260810 01:39:37.922729 15275 raft_consensus.cc:2454] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1372223cdf46268adb3c30eca95f7d in term 0.
I20260810 01:39:37.923010 15393 leader_election.cc:302] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad1372223cdf46268adb3c30eca95f7d, b1d431af95f44392be9a7897aa337763; no voters:
I20260810 01:39:37.923321 15844 raft_consensus.cc:2781] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:39:37.923406 15844 raft_consensus.cc:482] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:39:37.923439 15844 raft_consensus.cc:3037] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:37.924641 15844 raft_consensus.cc:504] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.925043 15844 leader_election.cc:288] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [CANDIDATE]: Term 1 election: Requested vote from peers cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511), b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353)
I20260810 01:39:37.925381 15275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056b4ed4e422496f8e729dd387834b66" candidate_uuid: "ad1372223cdf46268adb3c30eca95f7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefa6ac152044dee99e5fe3c4b7c619a"
I20260810 01:39:37.925473 15732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056b4ed4e422496f8e729dd387834b66" candidate_uuid: "ad1372223cdf46268adb3c30eca95f7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d431af95f44392be9a7897aa337763"
I20260810 01:39:37.925520 15275 raft_consensus.cc:3037] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:37.925628 15732 raft_consensus.cc:3037] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:37.926640 15275 raft_consensus.cc:2454] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1372223cdf46268adb3c30eca95f7d in term 1.
I20260810 01:39:37.926697 15732 raft_consensus.cc:2454] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1372223cdf46268adb3c30eca95f7d in term 1.
I20260810 01:39:37.926941 15391 leader_election.cc:302] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad1372223cdf46268adb3c30eca95f7d, cefa6ac152044dee99e5fe3c4b7c619a; no voters:
I20260810 01:39:37.927162 15844 raft_consensus.cc:2781] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:37.927362 15844 raft_consensus.cc:686] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 1 LEADER]: Becoming Leader. State: Replica: ad1372223cdf46268adb3c30eca95f7d, State: Running, Role: LEADER
I20260810 01:39:37.927690 15844 consensus_queue.cc:237] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:37.931152 15035 catalog_manager.cc:5495] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d reported cstate change: term changed from 0 to 1, leader changed from <none> to ad1372223cdf46268adb3c30eca95f7d (127.24.205.130). New cstate: current_term: 1 leader_uuid: "ad1372223cdf46268adb3c30eca95f7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } health_report { overall_health: UNKNOWN } } }
I20260810 01:39:37.959328 15834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:37.955738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44512 (local address 127.24.205.130:36655)
0810 01:39:37.955884 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:37.955891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:37.955908 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:39:37.955995 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:37.955997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:37.956052 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:37.956226 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:39:37.956494 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.956997 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.957914 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:37.958143 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:37.958257 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:37.958576 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:39:37.958952 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:39:37.959098 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:37.959136 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 01:39:37.959189 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 01:39:37.964879 15732 raft_consensus.cc:1261] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 1 FOLLOWER]: Refusing update from remote peer ad1372223cdf46268adb3c30eca95f7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:37.964922 15275 raft_consensus.cc:1261] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Refusing update from remote peer ad1372223cdf46268adb3c30eca95f7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:37.965613 15844 consensus_queue.cc:1035] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:37.965801 15852 consensus_queue.cc:1035] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:39:37.967749 15803 tablet.cc:2369] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:39:37.974496 15860 mvcc.cc:205] Tried to move back new op lower bound from 7316791205737086976 to 7316791205594820608. Current Snapshot: MvccSnapshot[applied={T|T < 7316791205737086976}]
I20260810 01:39:37.982244 15036 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:37.982438 15036 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:37.985075 15036 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Sending DeleteTablet for 3 replicas of tablet 056b4ed4e422496f8e729dd387834b66
I20260810 01:39:37.986012 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 15150
I20260810 01:39:37.986030 15249 tablet_service.cc:1514] Processing DeleteTablet for tablet 056b4ed4e422496f8e729dd387834b66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:37 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:35200
I20260810 01:39:37.986055 15468 tablet_service.cc:1514] Processing DeleteTablet for tablet 056b4ed4e422496f8e729dd387834b66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:37 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:44508
I20260810 01:39:37.986526 15690 tablet_service.cc:1514] Processing DeleteTablet for tablet 056b4ed4e422496f8e729dd387834b66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:37 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:46322
I20260810 01:39:37.993700 15883 tablet_replica.cc:330] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: stopping tablet replica
I20260810 01:39:37.993732 15882 tablet_replica.cc:330] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: stopping tablet replica
I20260810 01:39:37.994099 15883 raft_consensus.cc:2229] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:39:37.994307 15882 raft_consensus.cc:2229] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:39:37.994587 15883 raft_consensus.cc:2258] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:37.994808 15882 raft_consensus.cc:2258] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:37.996292 15883 ts_tablet_manager.cc:1905] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:37.996754 15882 ts_tablet_manager.cc:1905] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:37.999174 15883 ts_tablet_manager.cc:1918] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:37.999341 15883 log.cc:1196] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/056b4ed4e422496f8e729dd387834b66
I20260810 01:39:37.999739 15883 ts_tablet_manager.cc:1939] T 056b4ed4e422496f8e729dd387834b66 P b1d431af95f44392be9a7897aa337763: Deleting consensus metadata
I20260810 01:39:38.000248 15882 ts_tablet_manager.cc:1918] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:38.000356 15882 log.cc:1196] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/056b4ed4e422496f8e729dd387834b66
I20260810 01:39:38.000672 15882 ts_tablet_manager.cc:1939] T 056b4ed4e422496f8e729dd387834b66 P ad1372223cdf46268adb3c30eca95f7d: Deleting consensus metadata
I20260810 01:39:38.001314 15018 catalog_manager.cc:4841] TS b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353): tablet 056b4ed4e422496f8e729dd387834b66 (table test-table [id=9c1add0b4efb4567883d5f8c9dd1c3cb]) successfully deleted
I20260810 01:39:38.001833 15018 catalog_manager.cc:4841] TS ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655): tablet 056b4ed4e422496f8e729dd387834b66 (table test-table [id=9c1add0b4efb4567883d5f8c9dd1c3cb]) successfully deleted
W20260810 01:39:38.002394 15017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:43511 (error 108)
I20260810 01:39:38.003304 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 15361
I20260810 01:39:38.003508 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.003191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43511 (local address 127.0.0.1:35216)
0810 01:39:38.003364 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.003431 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260810 01:39:38.012356 15017 catalog_manager.cc:4584] TS cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 056b4ed4e422496f8e729dd387834b66: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43511: connect: Connection refused (error 111)
I20260810 01:39:38.019670 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 15589
I20260810 01:39:38.031960 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 14982
I20260810 01:39:38.049127 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46609
--webserver_interface=127.24.205.190
--webserver_port=43657
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:46609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:38.166060 15890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:38.166334 15890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:38.166375 15890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:38.170428 15890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:38.170495 15890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:38.170514 15890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:38.170531 15890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:38.170598 15890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:38.175954 15890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:46609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=43657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:38.177153 15890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:38.178248 15890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:38.193125 15910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:38.193125 15901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:38.193223 15890 server_base.cc:1034] running on GCE node
W20260810 01:39:38.193125 15904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:38.194193 15890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:38.195433 15890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:38.196650 15890 hybrid_clock.cc:648] HybridClock initialized: now 1786325978196615 us; error 61 us; skew 500 ppm
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:38.199542 15890 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:38.200589 15890 webserver.cc:460] Webserver started at http://127.24.205.190:43657/ using document root <none> and password file <none>
I20260810 01:39:38.201218 15890 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:38.201334 15890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:38.205488 15890 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:39:38.207849 15923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.209329 15890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:38.209568 15890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "3f56406ba7604e93b01d8a85ea59d232"
format_stamp: "Formatted at 2026-08-10 01:39:36 on dist-test-slave-t3q3"
server_key: "2ed073032bf0657f564344c780d970ca"
server_key_iv: "c491bb6bc912c7f95d12e2a9f8d67900"
server_key_version: "encryptionkey@0"
I20260810 01:39:38.210500 15890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:38.223060 15890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:38.226128 15890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:38.226341 15890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:38.233946 15890 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:46609
I20260810 01:39:38.234263 16008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:46609 every 8 connection(s)
I20260810 01:39:38.235146 15890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:38.236429 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 15890
I20260810 01:39:38.237020 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:43511
--local_ip_for_outbound_sockets=127.24.205.129
--tserver_master_addrs=127.24.205.190:46609
--webserver_port=33441
--webserver_interface=127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:39:38.241158 16010 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:39:38.243014 16010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Bootstrap starting.
I20260810 01:39:38.260568 16010 log.cc:824] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:38.269308 16010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:39:38.269727 16010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Bootstrap complete.
I20260810 01:39:38.273976 16010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:38.274363 16010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f56406ba7604e93b01d8a85ea59d232, State: Initialized, Role: FOLLOWER
I20260810 01:39:38.274852 16010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:38.274967 16010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:39:38.275064 16010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:39:38.275188 16010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:39:38.277140 16010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:38.277484 16010 leader_election.cc:302] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f56406ba7604e93b01d8a85ea59d232; no voters:
I20260810 01:39:38.277843 16010 leader_election.cc:288] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:39:38.277940 16017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:39:38.278163 16017 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 LEADER]: Becoming Leader. State: Replica: 3f56406ba7604e93b01d8a85ea59d232, State: Running, Role: LEADER
I20260810 01:39:38.278455 16017 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:38.279121 16010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:38.279852 16018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3f56406ba7604e93b01d8a85ea59d232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } } }
I20260810 01:39:38.279979 16018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:38.280742 16019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f56406ba7604e93b01d8a85ea59d232. Latest consensus state: current_term: 2 leader_uuid: "3f56406ba7604e93b01d8a85ea59d232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } } }
I20260810 01:39:38.280933 16019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:38.281184 16029 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:38.286440 16029 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:38.287039 16029 catalog_manager.cc:1259] Loaded cluster ID: a31467d9db134b388ea433f5f8a7916c
I20260810 01:39:38.287099 16029 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:39:38.288439 16029 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 01:39:38.292896 16029 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 01:39:38.298460 16029 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:39:38.299226 16029 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Loaded TSK: 0
I20260810 01:39:38.300467 16029 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:39:38.361146 16013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:38.361397 16013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:38.361438 16013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:38.366758 16013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:38.366820 16013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:38.366902 16013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:39:38.372227 16013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:43511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=33441
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:38.373281 16013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:38.374320 16013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:38.385473 16054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:38.385440 16050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:38.385699 16013 server_base.cc:1034] running on GCE node
W20260810 01:39:38.385447 16058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:38.386257 16013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:38.386938 16013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:38.388163 16013 hybrid_clock.cc:648] HybridClock initialized: now 1786325978388135 us; error 34 us; skew 500 ppm
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:38.391364 16013 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:39:38.392479 16013 webserver.cc:460] Webserver started at http://127.24.205.129:33441/ using document root <none> and password file <none>
I20260810 01:39:38.393128 16013 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:38.393252 16013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:38.397240 16013 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260810 01:39:38.399546 16070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.400908 16013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:38.401067 16013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "cefa6ac152044dee99e5fe3c4b7c619a"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "50d46723bd28828cabaa600be4dea6e7"
server_key_iv: "ed4c5c5de890b31f4088e114d4200738"
server_key_version: "encryptionkey@0"
I20260810 01:39:38.401609 16013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:38.424566 16013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:38.427850 16013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:38.428138 16013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:38.428777 16013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:38.430070 16081 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:39:38.434512 16013 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:39:38.434612 16013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260810 01:39:38.434702 16013 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:39:38.436506 16013 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:39:38.436578 16013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260810 01:39:38.436913 16081 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap starting.
I20260810 01:39:38.447208 16013 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:43511
I20260810 01:39:38.447252 16255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:43511 every 8 connection(s)
I20260810 01:39:38.448320 16013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:39:38.456328 16081 log.cc:824] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:38.456385 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 16013
I20260810 01:39:38.456930 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:36655
--local_ip_for_outbound_sockets=127.24.205.130
--tserver_master_addrs=127.24.205.190:46609
--webserver_port=35551
--webserver_interface=127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:38.466770 16081 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:39:38.467300 16081 tablet_bootstrap.cc:492] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap complete.
I20260810 01:39:38.468679 16081 ts_tablet_manager.cc:1397] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Time spent bootstrapping tablet: real 0.032s user 0.013s sys 0.017s
I20260810 01:39:38.469849 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.450498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:37857 (local address 127.24.205.190:46609)
0810 01:39:38.450965 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.450992 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.451280 (+ 288us) server_negotiation.cc:407] Connection header received
0810 01:39:38.452578 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.452596 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.453076 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.453550 (+ 474us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:38.454655 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.456282 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.458211 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.458944 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.459153 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.463237 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:38.463244 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:38.463262 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:38.463297 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:38.465600 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.466355 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.466361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.466367 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.466540 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.467064 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.467070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.467072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.467609 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:38.467758 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.468568 (+ 810us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.468914 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":140,"threads_started":1}
I20260810 01:39:38.470383 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.450396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:37857)
0810 01:39:38.451080 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.451135 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.451987 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.453570 (+ 1583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.453577 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.453958 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:38.454454 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.454471 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.456491 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.456496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.458022 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.458040 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.459128 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.459135 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.459431 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.460761 (+ 1330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:38.460782 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:38.462959 (+ 2177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:38.465751 (+ 2792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.465761 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.465778 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.466192 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.466664 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.466669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.466671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.466884 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.467755 (+ 871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:38.467765 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:38.468145 (+ 380us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.468400 (+ 255us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.468905 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":152,"threads_started":1}
I20260810 01:39:38.471750 16081 raft_consensus.cc:348] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:38.472255 16081 raft_consensus.cc:729] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa6ac152044dee99e5fe3c4b7c619a, State: Initialized, Role: FOLLOWER
I20260810 01:39:38.472815 16081 consensus_queue.cc:260] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } } peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } }
I20260810 01:39:38.473147 16256 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46609
I20260810 01:39:38.473393 16256 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:38.473908 16081 ts_tablet_manager.cc:1428] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:39:38.473963 16256 heartbeater.cc:511] Master 127.24.205.190:46609 requested a full tablet report, sending...
I20260810 01:39:38.476776 15953 ts_manager.cc:194] Registered new tserver with Master: cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511)
I20260810 01:39:38.481048 15953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:37857
I20260810 01:39:38.483814 16256 heartbeater.cc:503] Master 127.24.205.190:46609 was elected leader, sending a full tablet report...
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:39:38.492426 16268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.480517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43511 (local address 127.0.0.1:35224)
0810 01:39:38.481456 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.481493 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.481605 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.482412 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.482420 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.482894 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:38.483034 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.483042 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.484369 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.484376 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.485297 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.485308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.486060 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.486063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.486149 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.486750 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:38.486762 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:38.488387 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:38.490590 (+ 2203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.490599 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.490603 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.490837 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.491158 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.491160 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.491161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.491249 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.491802 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:38.491809 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:38.491929 (+ 120us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.492053 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.492294 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":150,"threads_started":1}
I20260810 01:39:38.492540 16271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.480587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35224 (local address 127.24.205.129:43511)
0810 01:39:38.481931 (+ 1344us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.481946 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.481970 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:39:38.482042 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.482046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.482236 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.482374 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:38.483170 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.484251 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.485435 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.485932 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.486047 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.488536 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:38.488546 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:38.488560 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:38.488587 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:38.490469 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.490953 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.490959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.490961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.491062 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.491338 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.491341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.491343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.491650 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:38.491813 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.492191 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.492376 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1209,"thread_start_us":98,"threads_started":1}
I20260810 01:39:38.493690 16148 tablet_service.cc:1514] Processing DeleteTablet for tablet 056b4ed4e422496f8e729dd387834b66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:37 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:35224
I20260810 01:39:38.494612 16274 tablet_replica.cc:330] stopping tablet replica
I20260810 01:39:38.494944 16274 raft_consensus.cc:2229] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:39:38.495210 16274 raft_consensus.cc:2258] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:38.496392 16274 ts_tablet_manager.cc:1905] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:38.501097 16274 ts_tablet_manager.cc:1918] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:38.501206 16274 log.cc:1196] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/056b4ed4e422496f8e729dd387834b66
I20260810 01:39:38.501531 16274 ts_tablet_manager.cc:1939] T 056b4ed4e422496f8e729dd387834b66 P cefa6ac152044dee99e5fe3c4b7c619a: Deleting consensus metadata
I20260810 01:39:38.503533 15928 catalog_manager.cc:4841] TS cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511): tablet 056b4ed4e422496f8e729dd387834b66 (table test-table [id=9c1add0b4efb4567883d5f8c9dd1c3cb]) successfully deleted
W20260810 01:39:38.587968 16262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:38.588328 16262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:38.588400 16262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:38.592501 16262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:38.592559 16262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:38.592665 16262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:39:38.598140 16262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:36655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=35551
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:38.599184 16262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:38.600301 16262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:38.610342 16281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:38.610374 16283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:38.610352 16280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:38.610692 16262 server_base.cc:1034] running on GCE node
I20260810 01:39:38.611150 16262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:38.611797 16262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:38.612980 16262 hybrid_clock.cc:648] HybridClock initialized: now 1786325978612940 us; error 42 us; skew 500 ppm
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:38.616030 16262 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:39:38.616959 16262 webserver.cc:460] Webserver started at http://127.24.205.130:35551/ using document root <none> and password file <none>
I20260810 01:39:38.617543 16262 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:38.617664 16262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:38.621567 16262 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:39:38.623637 16292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.624909 16262 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:39:38.625051 16262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "ad1372223cdf46268adb3c30eca95f7d"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "982c8bcb8fe5ced9ecc3bc05959cf3b0"
server_key_iv: "118dfa1c57992a84b2665c1478dc72b4"
server_key_version: "encryptionkey@0"
I20260810 01:39:38.625659 16262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:38.639205 16262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:38.642562 16262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:38.642776 16262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:38.643397 16262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:38.644291 16262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:38.644364 16262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.644438 16262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:38.644492 16262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.654072 16262 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36655
I20260810 01:39:38.654100 16471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36655 every 8 connection(s)
I20260810 01:39:38.655098 16262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:39:38.656256 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 16262
I20260810 01:39:38.656757 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:46353
--local_ip_for_outbound_sockets=127.24.205.131
--tserver_master_addrs=127.24.205.190:46609
--webserver_port=41711
--webserver_interface=127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:38.671188 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.657200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:47535 (local address 127.24.205.190:46609)
0810 01:39:38.657338 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.657342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.658310 (+ 968us) server_negotiation.cc:407] Connection header received
0810 01:39:38.660279 (+ 1969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.660282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.660337 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.660412 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:38.661613 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.662575 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.663760 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.664268 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.664396 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.667063 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:38.667071 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:38.667077 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:38.667123 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:38.669051 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.669607 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.669614 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.669617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.669720 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.670060 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.670063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.670065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.670298 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:38.670399 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.670869 (+ 470us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.671006 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:39:38.671968 16479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.657608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:47535)
0810 01:39:38.658131 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.658193 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.659996 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.660605 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.660614 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.660971 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:38.661446 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.661459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.662707 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.662709 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.663626 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.663636 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.664443 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.664449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.664665 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.665410 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:38.665426 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:38.666882 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:38.669226 (+ 2344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.669231 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.669242 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.669502 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.669825 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.669828 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.669829 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.669963 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.670404 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:38.670409 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:38.670636 (+ 227us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.670797 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.671047 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":152,"threads_started":1}
I20260810 01:39:38.673378 16473 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46609
I20260810 01:39:38.673620 16473 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:38.674104 16473 heartbeater.cc:511] Master 127.24.205.190:46609 requested a full tablet report, sending...
I20260810 01:39:38.675132 15953 ts_manager.cc:194] Registered new tserver with Master: ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655)
I20260810 01:39:38.675711 15953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:47535
W20260810 01:39:38.775218 16480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:38.775475 16480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:38.775516 16480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:38.779635 16480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:38.779702 16480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:38.779779 16480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:39:38.785537 16480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:46353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=41711
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:38.786687 16480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:38.787777 16480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:38.797962 16490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:38.797962 16493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:38.797962 16489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:38.798336 16480 server_base.cc:1034] running on GCE node
I20260810 01:39:38.798753 16480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:38.799372 16480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:38.800532 16480 hybrid_clock.cc:648] HybridClock initialized: now 1786325978800511 us; error 34 us; skew 500 ppm
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:38.803296 16480 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:39:38.804239 16480 webserver.cc:460] Webserver started at http://127.24.205.131:41711/ using document root <none> and password file <none>
I20260810 01:39:38.804812 16480 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:38.804888 16480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:38.809080 16480 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260810 01:39:38.811216 16503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.812544 16480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:39:38.812675 16480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "b1d431af95f44392be9a7897aa337763"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "ae04fb976647b459871320a82f75badc"
server_key_iv: "b46a38dedb07a611f40484169f87b38d"
server_key_version: "encryptionkey@0"
I20260810 01:39:38.813252 16480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:38.832499 16480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:38.835383 16480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:38.835589 16480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:38.836256 16480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:38.837077 16480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:38.837126 16480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.837203 16480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:38.837240 16480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:38.846630 16480 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:46353
I20260810 01:39:38.846657 16681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:46353 every 8 connection(s)
I20260810 01:39:38.847633 16480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:39:38.855096 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 16480
Aug 10 01:39:38 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325978, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:38.861727 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.849513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:39795 (local address 127.24.205.190:46609)
0810 01:39:38.849650 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.849654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.850479 (+ 825us) server_negotiation.cc:407] Connection header received
0810 01:39:38.851856 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.851859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.851917 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.851997 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:38.853183 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.853775 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.854966 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.855258 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.855403 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.857901 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:38.857905 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:38.857907 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:38.857931 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:38.859412 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.860113 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.860132 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.860134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.860211 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.860634 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.860636 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.860637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.860811 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:38.860930 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.861422 (+ 492us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.861540 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53,"spinlock_wait_cycles":4992}
I20260810 01:39:38.862463 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.849877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:39795)
0810 01:39:38.850330 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.850375 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.851643 (+ 1268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.852199 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.852207 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.852548 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:38.853029 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.853043 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.853907 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.853913 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.854837 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.854846 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.855442 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.855447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.855647 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.856303 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:38.856319 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:38.857736 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:38.859531 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.859535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.859575 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.859968 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.860314 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:38.860318 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:38.860321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:38.860504 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:38.860927 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:38.860934 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:38.861174 (+ 240us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.861377 (+ 203us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.861688 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":119,"threads_started":1}
I20260810 01:39:38.863591 16682 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46609
I20260810 01:39:38.863844 16682 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:38.864329 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.855789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46500 (local address 127.24.205.190:46609)
0810 01:39:38.856102 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.856107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.856296 (+ 189us) server_negotiation.cc:407] Connection header received
0810 01:39:38.856459 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.856462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.856513 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.856627 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:38.857380 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.857911 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.858797 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.859021 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.859129 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.860687 (+ 1558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:38.860690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:38.860692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:38.860725 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:38.862343 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.862812 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.862816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.862818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.862912 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:38.863223 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:38.863227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:38.863229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:38.863395 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:38.863609 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.864112 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.864222 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"spinlock_wait_cycles":2304,"thread_start_us":101,"threads_started":1}
I20260810 01:39:38.864372 16682 heartbeater.cc:511] Master 127.24.205.190:46609 requested a full tablet report, sending...
I20260810 01:39:38.865533 15953 ts_manager.cc:194] Registered new tserver with Master: b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353)
I20260810 01:39:38.866245 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:39:38.866233 15953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:39795
I20260810 01:39:38.870340 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.866884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46510 (local address 127.24.205.190:46609)
0810 01:39:38.867004 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.867007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.867282 (+ 275us) server_negotiation.cc:407] Connection header received
0810 01:39:38.867433 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.867435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.867515 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.867588 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:39:38.867831 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.868359 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.869145 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.869350 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.869424 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.869668 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:39:38.869999 (+ 331us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:39:38.870085 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.870154 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.870197 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:39:38.870973 15953 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:46510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:39:38.874171 15953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:39:38.881738 16148 tablet_service.cc:1467] Processing CreateTablet for tablet 8362f8c794574717a9de68e0dd25565b (DEFAULT_TABLE table=test-table [id=efed39ea843441dc8eec3af6528e0445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:38.882465 16148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8362f8c794574717a9de68e0dd25565b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:38.886288 16081 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap starting.
I20260810 01:39:38.886351 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.881429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44514 (local address 127.24.205.130:36655)
0810 01:39:38.881742 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.881757 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.881781 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:39:38.881857 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.881861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.882063 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.882231 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:38.882416 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.883118 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.884875 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.885747 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.885889 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.886022 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.886127 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.886215 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":109,"threads_started":1}
I20260810 01:39:38.886430 16268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.880604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:46353 (local address 127.0.0.1:46324)
0810 01:39:38.880779 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.880795 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.880874 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.881969 (+ 1095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.881972 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.881991 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:38.882090 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.882096 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.883669 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.883673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.884809 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.884820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.885985 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.885991 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.886096 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.886128 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.886187 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.886282 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 01:39:38.886305 16696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.880977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36655 (local address 127.0.0.1:44514)
0810 01:39:38.881215 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.881230 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.881316 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.882217 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.882220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.882237 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:38.882318 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.882324 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.883259 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.883263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.884719 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.884731 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.885875 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.885879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.885966 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.886009 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.886100 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.886175 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":108,"threads_started":1}
I20260810 01:39:38.886816 16694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.880818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46324 (local address 127.24.205.131:46353)
0810 01:39:38.881477 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.881489 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.881512 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:39:38.881601 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.881607 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.881810 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.881980 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:38.882463 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.883490 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.884905 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.885815 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.886401 (+ 586us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.886528 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.886579 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.886669 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":161,"threads_started":1}
I20260810 01:39:38.887259 16081 tablet_bootstrap.cc:654] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:38.888792 16081 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: No bootstrap required, opened a new log
I20260810 01:39:38.888904 16081 ts_tablet_manager.cc:1397] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:39:38.889308 16081 raft_consensus.cc:348] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.889431 16081 raft_consensus.cc:374] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:38.889483 16081 raft_consensus.cc:729] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa6ac152044dee99e5fe3c4b7c619a, State: Initialized, Role: FOLLOWER
I20260810 01:39:38.889619 16081 consensus_queue.cc:260] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.889912 16081 ts_tablet_manager.cc:1428] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:39:38.889534 16378 tablet_service.cc:1467] Processing CreateTablet for tablet 8362f8c794574717a9de68e0dd25565b (DEFAULT_TABLE table=test-table [id=efed39ea843441dc8eec3af6528e0445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:38.889534 16576 tablet_service.cc:1467] Processing CreateTablet for tablet 8362f8c794574717a9de68e0dd25565b (DEFAULT_TABLE table=test-table [id=efed39ea843441dc8eec3af6528e0445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:38.890662 16576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8362f8c794574717a9de68e0dd25565b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:38.892030 16378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8362f8c794574717a9de68e0dd25565b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:38.899355 16699 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Bootstrap starting.
I20260810 01:39:38.900235 16700 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Bootstrap starting.
I20260810 01:39:38.902107 16699 tablet_bootstrap.cc:654] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:38.902392 16700 tablet_bootstrap.cc:654] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:38.902917 16699 log.cc:824] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:38.903120 16700 log.cc:824] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:38.905129 16699 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: No bootstrap required, opened a new log
I20260810 01:39:38.905124 16700 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: No bootstrap required, opened a new log
I20260810 01:39:38.905344 16699 ts_tablet_manager.cc:1397] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:39:38.905352 16700 ts_tablet_manager.cc:1397] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260810 01:39:38.908293 16700 raft_consensus.cc:348] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.908293 16699 raft_consensus.cc:348] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.908509 16700 raft_consensus.cc:374] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:38.908535 16699 raft_consensus.cc:374] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:38.908576 16700 raft_consensus.cc:729] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1372223cdf46268adb3c30eca95f7d, State: Initialized, Role: FOLLOWER
I20260810 01:39:38.908622 16699 raft_consensus.cc:729] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d431af95f44392be9a7897aa337763, State: Initialized, Role: FOLLOWER
I20260810 01:39:38.909046 16700 consensus_queue.cc:260] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.909050 16699 consensus_queue.cc:260] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.910076 16699 ts_tablet_manager.cc:1428] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:39:38.910077 16473 heartbeater.cc:503] Master 127.24.205.190:46609 was elected leader, sending a full tablet report...
I20260810 01:39:38.910076 16700 ts_tablet_manager.cc:1428] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:39:38.910429 16682 heartbeater.cc:503] Master 127.24.205.190:46609 was elected leader, sending a full tablet report...
W20260810 01:39:38.949637 16257 tablet.cc:2369] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:39:38.984684 16706 raft_consensus.cc:482] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:38.984970 16706 raft_consensus.cc:504] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.986543 16706 leader_election.cc:288] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655), cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511)
I20260810 01:39:38.991703 16271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.987016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:37539 (local address 127.24.205.129:43511)
0810 01:39:38.987183 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.987190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.987209 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:39:38.987269 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.987274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.987346 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.987456 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:38.987760 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.988673 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.990301 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.990963 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.991070 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.991240 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.991505 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.991582 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 01:39:38.991703 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.986791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43511 (local address 127.24.205.131:37539)
0810 01:39:38.986933 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.986951 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.987083 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.987480 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.987483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.987501 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:38.987635 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.987642 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.988776 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.988779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.990148 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.990159 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.991170 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.991174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.991340 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.991390 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.991483 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.991559 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":175}
I20260810 01:39:38.991804 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.987006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:43411 (local address 127.24.205.130:36655)
0810 01:39:38.987293 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:38.987299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:38.987372 (+ 73us) server_negotiation.cc:407] Connection header received
0810 01:39:38.987560 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:38.987563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:38.987634 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:38.987690 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:38.988047 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.988596 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.990309 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.990920 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.991035 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.991090 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:38.991550 (+ 460us) server_negotiation.cc:299] Negotiation successful
0810 01:39:38.991650 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260810 01:39:38.992302 16707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:38.986791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36655 (local address 127.24.205.131:43411)
0810 01:39:38.987265 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:38.987280 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:38.987403 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:38.987832 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:38.987834 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:38.987848 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:38.987935 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.987939 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.988716 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.988721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.990156 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:38.990161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:38.991139 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:38.991144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:38.991287 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:38.991405 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 01:39:38.992003 (+ 598us) client_negotiation.cc:240] Negotiation successful
0810 01:39:38.992116 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":231,"thread_start_us":132,"threads_started":1}
I20260810 01:39:38.992326 16183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8362f8c794574717a9de68e0dd25565b" candidate_uuid: "b1d431af95f44392be9a7897aa337763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" is_pre_election: true
I20260810 01:39:38.992654 16183 raft_consensus.cc:2454] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d431af95f44392be9a7897aa337763 in term 0.
I20260810 01:39:38.993043 16411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8362f8c794574717a9de68e0dd25565b" candidate_uuid: "b1d431af95f44392be9a7897aa337763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1372223cdf46268adb3c30eca95f7d" is_pre_election: true
I20260810 01:39:38.993219 16510 leader_election.cc:302] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1d431af95f44392be9a7897aa337763, cefa6ac152044dee99e5fe3c4b7c619a; no voters:
I20260810 01:39:38.993348 16411 raft_consensus.cc:2454] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1d431af95f44392be9a7897aa337763 in term 0.
I20260810 01:39:38.993568 16706 raft_consensus.cc:2781] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:39:38.993660 16706 raft_consensus.cc:482] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:39:38.993714 16706 raft_consensus.cc:3037] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:38.994776 16706 raft_consensus.cc:504] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:38.995152 16706 leader_election.cc:288] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [CANDIDATE]: Term 1 election: Requested vote from peers ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655), cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511)
I20260810 01:39:38.995494 16183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8362f8c794574717a9de68e0dd25565b" candidate_uuid: "b1d431af95f44392be9a7897aa337763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefa6ac152044dee99e5fe3c4b7c619a"
I20260810 01:39:38.995479 16411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8362f8c794574717a9de68e0dd25565b" candidate_uuid: "b1d431af95f44392be9a7897aa337763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1372223cdf46268adb3c30eca95f7d"
I20260810 01:39:38.995639 16411 raft_consensus.cc:3037] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:38.995647 16183 raft_consensus.cc:3037] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:38.996802 16183 raft_consensus.cc:2454] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d431af95f44392be9a7897aa337763 in term 1.
I20260810 01:39:38.997120 16510 leader_election.cc:302] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1d431af95f44392be9a7897aa337763, cefa6ac152044dee99e5fe3c4b7c619a; no voters:
I20260810 01:39:38.997248 16411 raft_consensus.cc:2454] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1d431af95f44392be9a7897aa337763 in term 1.
I20260810 01:39:38.997301 16706 raft_consensus.cc:2781] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:38.997565 16706 raft_consensus.cc:686] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 1 LEADER]: Becoming Leader. State: Replica: b1d431af95f44392be9a7897aa337763, State: Running, Role: LEADER
I20260810 01:39:38.997926 16706 consensus_queue.cc:237] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:39.001525 15953 catalog_manager.cc:5495] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1d431af95f44392be9a7897aa337763 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "b1d431af95f44392be9a7897aa337763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } health_report { overall_health: UNKNOWN } } }
I20260810 01:39:39.028805 16694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.024654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46340 (local address 127.24.205.131:46353)
0810 01:39:39.024784 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:39.024788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:39.024814 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:39:39.024893 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:39.024895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:39.024949 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:39.025053 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:39:39.025357 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:39.026252 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:39.027174 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:39.027411 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:39.027526 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:39.027870 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:39:39.028380 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:39:39.028520 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:39.028588 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 01:39:39.028652 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:39:39.036046 16183 raft_consensus.cc:1261] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Refusing update from remote peer b1d431af95f44392be9a7897aa337763: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:39.036048 16411 raft_consensus.cc:1261] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 1 FOLLOWER]: Refusing update from remote peer b1d431af95f44392be9a7897aa337763: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:39.036856 16710 consensus_queue.cc:1035] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:39.037076 16706 consensus_queue.cc:1035] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:39.053303 15945 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:46510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:39.053524 15945 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:46510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:39.056324 15945 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Sending DeleteTablet for 3 replicas of tablet 8362f8c794574717a9de68e0dd25565b
I20260810 01:39:39.057111 16148 tablet_service.cc:1514] Processing DeleteTablet for tablet 8362f8c794574717a9de68e0dd25565b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:39 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:35224
I20260810 01:39:39.057231 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 16013
I20260810 01:39:39.057183 16576 tablet_service.cc:1514] Processing DeleteTablet for tablet 8362f8c794574717a9de68e0dd25565b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:39 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:46324
I20260810 01:39:39.063380 16378 tablet_service.cc:1514] Processing DeleteTablet for tablet 8362f8c794574717a9de68e0dd25565b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:39 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:44514
I20260810 01:39:39.065478 16730 tablet_replica.cc:330] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: stopping tablet replica
I20260810 01:39:39.065861 16730 raft_consensus.cc:2229] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:39:39.066212 16730 raft_consensus.cc:2258] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:39.072252 16729 tablet_replica.cc:330] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: stopping tablet replica
I20260810 01:39:39.072713 16729 raft_consensus.cc:2229] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:39:39.073210 16729 raft_consensus.cc:2258] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:39.074829 16729 ts_tablet_manager.cc:1905] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:39.074963 16730 ts_tablet_manager.cc:1905] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:39.077769 16729 ts_tablet_manager.cc:1918] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:39.077953 16729 log.cc:1196] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/8362f8c794574717a9de68e0dd25565b
I20260810 01:39:39.078379 16729 ts_tablet_manager.cc:1939] T 8362f8c794574717a9de68e0dd25565b P b1d431af95f44392be9a7897aa337763: Deleting consensus metadata
I20260810 01:39:39.078521 16730 ts_tablet_manager.cc:1918] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:39.078639 16730 log.cc:1196] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/8362f8c794574717a9de68e0dd25565b
I20260810 01:39:39.078999 16730 ts_tablet_manager.cc:1939] T 8362f8c794574717a9de68e0dd25565b P ad1372223cdf46268adb3c30eca95f7d: Deleting consensus metadata
I20260810 01:39:39.080179 15929 catalog_manager.cc:4841] TS b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353): tablet 8362f8c794574717a9de68e0dd25565b (table test-table [id=efed39ea843441dc8eec3af6528e0445]) successfully deleted
I20260810 01:39:39.080470 15929 catalog_manager.cc:4841] TS ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655): tablet 8362f8c794574717a9de68e0dd25565b (table test-table [id=efed39ea843441dc8eec3af6528e0445]) successfully deleted
W20260810 01:39:39.080710 15928 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:43511 (error 108)
W20260810 01:39:39.081810 16696 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:39:39.081481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43511 (local address 127.0.0.1:35230)
0810 01:39:39.081626 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.081643 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:39.081713 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43511: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 01:39:39.082067 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 16262
W20260810 01:39:39.081977 15928 catalog_manager.cc:4584] TS cefa6ac152044dee99e5fe3c4b7c619a (127.24.205.129:43511): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8362f8c794574717a9de68e0dd25565b: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43511: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260810 01:39:39.107412 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 16480
I20260810 01:39:39.120718 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 15890
I20260810 01:39:39.134686 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46609
--webserver_interface=127.24.205.190
--webserver_port=43657
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:46609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:39.251240 16732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:39.251515 16732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:39.251557 16732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:39.255613 16732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:39.255673 16732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:39.255692 16732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:39.255734 16732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:39.255771 16732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:39.261041 16732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:46609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=43657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:39.262146 16732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:39.263231 16732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:39:39.271917 16732 server_base.cc:1034] running on GCE node
W20260810 01:39:39.271888 16739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:39.271879 16742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:39.271873 16744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:39.272785 16732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:39.273962 16732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:39.275139 16732 hybrid_clock.cc:648] HybridClock initialized: now 1786325979275121 us; error 30 us; skew 500 ppm
Aug 10 01:39:39 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325979, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:39.278020 16732 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:39.278990 16732 webserver.cc:460] Webserver started at http://127.24.205.190:43657/ using document root <none> and password file <none>
I20260810 01:39:39.279572 16732 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:39.279670 16732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:39.283654 16732 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:39:39.286108 16755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.287444 16732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 01:39:39.287598 16732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "3f56406ba7604e93b01d8a85ea59d232"
format_stamp: "Formatted at 2026-08-10 01:39:36 on dist-test-slave-t3q3"
server_key: "2ed073032bf0657f564344c780d970ca"
server_key_iv: "c491bb6bc912c7f95d12e2a9f8d67900"
server_key_version: "encryptionkey@0"
I20260810 01:39:39.288249 16732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:39.309269 16732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:39.312500 16732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:39.312713 16732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:39.320050 16732 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:46609
I20260810 01:39:39.320384 16836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:46609 every 8 connection(s)
I20260810 01:39:39.321249 16732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:39.321647 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 16732
I20260810 01:39:39.322129 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:43511
--local_ip_for_outbound_sockets=127.24.205.129
--tserver_master_addrs=127.24.205.190:46609
--webserver_port=33441
--webserver_interface=127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:39:39.325731 16837 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:39:39.327382 16837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Bootstrap starting.
I20260810 01:39:39.346104 16837 log.cc:824] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:39.358819 16837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:39:39.359304 16837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232: Bootstrap complete.
I20260810 01:39:39.363911 16837 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:39.364476 16837 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f56406ba7604e93b01d8a85ea59d232, State: Initialized, Role: FOLLOWER
I20260810 01:39:39.365048 16837 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:39.365273 16837 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:39:39.365357 16837 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:39:39.365471 16837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 2 FOLLOWER]: Advancing to term 3
I20260810 01:39:39.368701 16837 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:39.369091 16837 leader_election.cc:302] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f56406ba7604e93b01d8a85ea59d232; no voters:
I20260810 01:39:39.369467 16837 leader_election.cc:288] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 01:39:39.369563 16847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 01:39:39.369779 16847 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [term 3 LEADER]: Becoming Leader. State: Replica: 3f56406ba7604e93b01d8a85ea59d232, State: Running, Role: LEADER
I20260810 01:39:39.370081 16847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } }
I20260810 01:39:39.370765 16837 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:39.371064 16847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f56406ba7604e93b01d8a85ea59d232. Latest consensus state: current_term: 3 leader_uuid: "3f56406ba7604e93b01d8a85ea59d232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } } }
I20260810 01:39:39.371189 16847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:39.371575 16855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:39.371611 16852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3f56406ba7604e93b01d8a85ea59d232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f56406ba7604e93b01d8a85ea59d232" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46609 } } }
I20260810 01:39:39.371836 16852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f56406ba7604e93b01d8a85ea59d232 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:39.376940 16855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:39.377614 16855 catalog_manager.cc:1259] Loaded cluster ID: a31467d9db134b388ea433f5f8a7916c
I20260810 01:39:39.377674 16855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 01:39:39.378767 16855 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc90594d9ad google::LogMessage::Fail() at ??:0
@ 0x7fc90595088a google::LogMessage::SendToLog() at ??:0
@ 0x7fc90594d4de google::LogMessage::Flush() at ??:0
@ 0x7fc90594ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc910290fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fc910291d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc91028e579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fc9102d2640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fc907b9f3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc907b9fc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fc907ba13f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fc907b90512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc9091d46db start_thread at ??:0
@ 0x7fc90444b61f clone at ??:0
W20260810 01:39:39.469105 16843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:39.469529 16843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:39.469601 16843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:39.475984 16843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:39.476094 16843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:39.476199 16843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:39:39.484490 16843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:43511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=33441
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:39.485905 16843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:39.487335 16843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:39.499396 16906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:39.499398 16903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:39.499400 16902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:39.500643 16843 server_base.cc:1034] running on GCE node
I20260810 01:39:39.501129 16843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:39.501929 16843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:39.503139 16843 hybrid_clock.cc:648] HybridClock initialized: now 1786325979503113 us; error 33 us; skew 500 ppm
Aug 10 01:39:39 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325979, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:39.506678 16843 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:39:39.507841 16843 webserver.cc:460] Webserver started at http://127.24.205.129:33441/ using document root <none> and password file <none>
I20260810 01:39:39.508636 16843 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:39.508740 16843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:39.514125 16843 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:39:39.517022 16918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.518558 16843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:39.518677 16843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "cefa6ac152044dee99e5fe3c4b7c619a"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "50d46723bd28828cabaa600be4dea6e7"
server_key_iv: "ed4c5c5de890b31f4088e114d4200738"
server_key_version: "encryptionkey@0"
I20260810 01:39:39.519411 16843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:39.556290 16843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:39.559643 16843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:39.559852 16843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:39.560585 16843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:39.561746 16926 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:39:39.567359 16843 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:39:39.567461 16843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260810 01:39:39.567574 16843 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:39:39.569371 16843 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:39:39.569444 16843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260810 01:39:39.569768 16926 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap starting.
I20260810 01:39:39.580608 16843 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:43511
I20260810 01:39:39.580777 17125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:43511 every 8 connection(s)
I20260810 01:39:39.581604 16843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:39:39.590880 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 16843
I20260810 01:39:39.591336 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:36655
--local_ip_for_outbound_sockets=127.24.205.130
--tserver_master_addrs=127.24.205.190:46609
--webserver_port=35551
--webserver_interface=127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:39:39.591986 16926 log.cc:824] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:39.600898 16926 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:39:39.601341 16926 tablet_bootstrap.cc:492] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Bootstrap complete.
I20260810 01:39:39.602777 16926 ts_tablet_manager.cc:1397] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.008s
I20260810 01:39:39.606071 16926 raft_consensus.cc:348] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:39.606628 16926 raft_consensus.cc:729] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefa6ac152044dee99e5fe3c4b7c619a, State: Initialized, Role: FOLLOWER
I20260810 01:39:39.607192 16926 consensus_queue.cc:260] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:39.608392 16926 ts_tablet_manager.cc:1428] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260810 01:39:39.637317 17135 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:39:39.583479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:57885)
0810 01:39:39.583972 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.584024 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:39.584853 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:39.636323 (+ 51470us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":137,"threads_started":1}
W20260810 01:39:39.637921 17128 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:46609 (0 consecutive failures): Network error: Failed to ping master at 127.24.205.190:46609: Client connection negotiation failed: client connection to 127.24.205.190:46609: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:39:39.638794 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.638421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:33199)
0810 01:39:39.638604 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.638705 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 01:39:39.639566 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.639320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:50277)
0810 01:39:39.639445 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.639508 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 01:39:39.639770 17128 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:39:39.710670 17139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:39.710929 17139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:39.710973 17139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:39.715132 17139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:39.715201 17139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:39.715288 17139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:39:39.720669 17139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:36655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=35551
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:39.721762 17139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:39.722842 17139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:39.733042 17151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:39.733144 17149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:39.733141 17154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:39.733368 17139 server_base.cc:1034] running on GCE node
I20260810 01:39:39.733778 17139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:39.734436 17139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:39.735630 17139 hybrid_clock.cc:648] HybridClock initialized: now 1786325979735603 us; error 39 us; skew 500 ppm
Aug 10 01:39:39 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325979, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:39.738435 17139 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:39:39.739272 17139 webserver.cc:460] Webserver started at http://127.24.205.130:35551/ using document root <none> and password file <none>
I20260810 01:39:39.739791 17139 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:39.739850 17139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:39.743860 17139 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:39:39.746064 17169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.747293 17139 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 01:39:39.747390 17139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "ad1372223cdf46268adb3c30eca95f7d"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "982c8bcb8fe5ced9ecc3bc05959cf3b0"
server_key_iv: "118dfa1c57992a84b2665c1478dc72b4"
server_key_version: "encryptionkey@0"
I20260810 01:39:39.747926 17139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:39.758116 17139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:39.760885 17139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:39.761034 17139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:39.761530 17139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:39.762285 17139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:39.762331 17139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.762370 17139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:39.762391 17139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.771288 17139 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36655
I20260810 01:39:39.771318 17367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36655 every 8 connection(s)
I20260810 01:39:39.772357 17139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:39:39.776224 17374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.774547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:49535)
0810 01:39:39.775017 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.775446 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":117,"threads_started":1}
W20260810 01:39:39.776758 17368 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:46609 (0 consecutive failures): Network error: Failed to ping master at 127.24.205.190:46609: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
I20260810 01:39:39.777354 17374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.777148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:51977)
0810 01:39:39.777254 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.777302 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 01:39:39.777940 17374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.777760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:43981)
0810 01:39:39.777856 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.777896 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 01:39:39.778141 17368 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:39:39.779708 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 17139
I20260810 01:39:39.780190 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:46353
--local_ip_for_outbound_sockets=127.24.205.131
--tserver_master_addrs=127.24.205.190:46609
--webserver_port=41711
--webserver_interface=127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:39.895895 17375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:39.896183 17375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:39.896262 17375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:39.900214 17375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:39.900269 17375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:39.900367 17375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:39:39.905560 17375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:46353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=41711
--tserver_master_addrs=127.24.205.190:46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:39.906692 17375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:39.907740 17375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:39.917889 17390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:39.917948 17387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:39.918021 17375 server_base.cc:1034] running on GCE node
W20260810 01:39:39.917948 17383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:39.918759 17375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:39.919374 17375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:39.920547 17375 hybrid_clock.cc:648] HybridClock initialized: now 1786325979920523 us; error 36 us; skew 500 ppm
Aug 10 01:39:39 dist-test-slave-t3q3 krb5kdc[14958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325979, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:39.923439 17375 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:39:39.924466 17375 webserver.cc:460] Webserver started at http://127.24.205.131:41711/ using document root <none> and password file <none>
I20260810 01:39:39.925154 17375 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:39.925401 17375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:39.929761 17375 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:39:39.931910 17399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.933211 17375 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:39:39.933357 17375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "b1d431af95f44392be9a7897aa337763"
format_stamp: "Formatted at 2026-08-10 01:39:37 on dist-test-slave-t3q3"
server_key: "ae04fb976647b459871320a82f75badc"
server_key_iv: "b46a38dedb07a611f40484169f87b38d"
server_key_version: "encryptionkey@0"
I20260810 01:39:39.933915 17375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:39.948305 17375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:39.951671 17375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:39.951889 17375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:39.952574 17375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:39.953438 17375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:39.953512 17375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.953585 17375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:39.953637 17375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:39.962710 17375 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:46353
I20260810 01:39:39.962733 17590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:46353 every 8 connection(s)
I20260810 01:39:39.963704 17375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:39:39.967408 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.965834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:33407)
0810 01:39:39.966287 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.966723 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":116,"threads_started":1}
I20260810 01:39:39.967882 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 17375
W20260810 01:39:39.967957 17591 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:46609 (0 consecutive failures): Network error: Failed to ping master at 127.24.205.190:46609: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
I20260810 01:39:39.968552 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.968329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:37205)
0810 01:39:39.968441 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.968492 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 01:39:39.969305 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:39.969101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:40983)
0810 01:39:39.969204 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:39.969250 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 01:39:39.969480 17591 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:39:40.640942 17598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:40.640455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:47549)
0810 01:39:40.640750 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:40.640824 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":90,"threads_started":1}
I20260810 01:39:40.779072 17599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:40.778676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:46045)
0810 01:39:40.778921 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:40.778973 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":72,"threads_started":1}
I20260810 01:39:40.970453 17600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:40.970033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:55661)
0810 01:39:40.970300 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:40.970353 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":88,"threads_started":1}
I20260810 01:39:41.477687 17601 raft_consensus.cc:482] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:41.478078 17601 raft_consensus.cc:504] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:41.479285 17601 leader_election.cc:288] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353), ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655)
Aug 10 01:39:41 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325979, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.130@KRBTEST.COM
Aug 10 01:39:41 dist-test-slave-t3q3 krb5kdc[14958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325979, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.131@KRBTEST.COM
I20260810 01:39:41.494616 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:41.479971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36655 (local address 127.24.205.129:38745)
0810 01:39:41.480262 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:41.480273 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:41.480355 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:41.481828 (+ 1473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:41.481831 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:41.482334 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:41.482856 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:41.482872 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.484265 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.484267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:41.485970 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:41.485981 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.486726 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.486729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:41.486884 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:41.487573 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:41.487620 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:41.489429 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:41.491744 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:41.491750 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:41.491763 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:41.492134 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:41.492538 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:41.492540 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:41.492542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:41.492706 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:41.493517 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:41.493523 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:41.493778 (+ 255us) client_negotiation.cc:769] Sending connection context
0810 01:39:41.493967 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 01:39:41.494371 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":171,"spinlock_wait_cycles":768,"thread_start_us":107,"threads_started":1}
I20260810 01:39:41.494625 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:41.479746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:50707 (local address 127.24.205.131:46353)
0810 01:39:41.480205 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:41.480222 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:41.480272 (+ 50us) server_negotiation.cc:407] Connection header received
0810 01:39:41.481012 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:41.481019 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:41.481373 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:41.481626 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:41.483043 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.484006 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.486887 (+ 2881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.487534 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.487674 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:41.490065 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:41.490070 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:41.490080 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:41.490140 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:41.492258 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:41.492759 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:41.492767 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:41.492776 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:41.492909 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:41.493228 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:41.493230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:41.493231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:41.493685 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:41.493813 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:41.494182 (+ 369us) server_negotiation.cc:299] Negotiation successful
0810 01:39:41.494453 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":61,"threads_started":1}
I20260810 01:39:41.494657 17605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:41.480207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:38745 (local address 127.24.205.130:36655)
0810 01:39:41.480565 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:41.480576 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:41.480605 (+ 29us) server_negotiation.cc:407] Connection header received
0810 01:39:41.481223 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:41.481228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:41.481513 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:41.481846 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:41.483040 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.484129 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.486116 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.486612 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.486745 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:41.489719 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:41.489726 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:41.489743 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:41.489786 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:41.491616 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:41.492254 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:41.492259 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:41.492263 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:41.492428 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:41.492819 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:41.492821 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:41.492823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:41.493390 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:41.493492 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:41.494178 (+ 686us) server_negotiation.cc:299] Negotiation successful
0810 01:39:41.494470 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":134,"threads_started":1}
I20260810 01:39:41.494656 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:41.479596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:46353 (local address 127.24.205.129:50707)
0810 01:39:41.479861 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:41.479880 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:41.479993 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:41.481749 (+ 1756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:41.481757 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:41.482330 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:41.482856 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:41.482871 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.484193 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.484199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:41.485969 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:41.485981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:41.487673 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:41.487676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:41.487777 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:41.488270 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:41.488286 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:41.489837 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:41.492374 (+ 2537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:41.492377 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:41.492379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:41.492647 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:41.493037 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:41.493040 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:41.493042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:41.493136 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:41.493807 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:41.493809 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:41.493888 (+ 79us) client_negotiation.cc:769] Sending connection context
0810 01:39:41.494002 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 01:39:41.494470 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":406,"spinlock_wait_cycles":17280,"thread_start_us":83,"threads_started":1}
W20260810 01:39:41.497568 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
W20260810 01:39:41.497794 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
I20260810 01:39:41.497862 16923 leader_election.cc:302] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cefa6ac152044dee99e5fe3c4b7c619a; no voters: ad1372223cdf46268adb3c30eca95f7d, b1d431af95f44392be9a7897aa337763
I20260810 01:39:41.498158 17601 raft_consensus.cc:2726] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:39:41.642053 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:41.641765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:53991)
0810 01:39:41.641905 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:41.641962 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 01:39:41.780390 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:41.779896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:54631)
0810 01:39:41.780209 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:41.780270 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":83,"threads_started":1}
I20260810 01:39:41.971593 17611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:41.971174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:47191)
0810 01:39:41.971417 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:41.971476 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":75,"threads_started":1}
I20260810 01:39:42.643410 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:42.642917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:56825)
0810 01:39:42.643232 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:42.643294 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":103,"threads_started":1}
I20260810 01:39:42.781577 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:42.781165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:47365)
0810 01:39:42.781423 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:42.781481 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":79,"threads_started":1}
I20260810 01:39:42.972774 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:42.972365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:39463)
0810 01:39:42.972622 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:42.972679 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":74,"threads_started":1}
I20260810 01:39:43.165598 17618 raft_consensus.cc:482] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:43.165786 17618 raft_consensus.cc:504] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:43.166251 17618 leader_election.cc:288] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353), ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655)
W20260810 01:39:43.167217 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
W20260810 01:39:43.167373 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
I20260810 01:39:43.167435 16923 leader_election.cc:302] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cefa6ac152044dee99e5fe3c4b7c619a; no voters: ad1372223cdf46268adb3c30eca95f7d, b1d431af95f44392be9a7897aa337763
I20260810 01:39:43.167632 17618 raft_consensus.cc:2726] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:39:43.644713 17619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:43.644264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:52295)
0810 01:39:43.644552 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:43.644614 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":94,"threads_started":1}
I20260810 01:39:43.783066 17621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:43.782544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:50091)
0810 01:39:43.782860 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:43.782930 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":98,"threads_started":1}
I20260810 01:39:43.974032 17622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:43.973585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:44743)
0810 01:39:43.973860 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:43.973916 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":76,"threads_started":1}
I20260810 01:39:44.646204 17623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:44.645685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:36791)
0810 01:39:44.646034 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:44.646099 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":83,"threads_started":1}
I20260810 01:39:44.784457 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:44.783940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:42621)
0810 01:39:44.784300 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:44.784358 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":184,"threads_started":1}
I20260810 01:39:44.792193 17626 raft_consensus.cc:482] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:44.792333 17626 raft_consensus.cc:504] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:44.792799 17626 leader_election.cc:288] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353), ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655)
W20260810 01:39:44.793782 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
W20260810 01:39:44.793952 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
I20260810 01:39:44.794034 16923 leader_election.cc:302] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cefa6ac152044dee99e5fe3c4b7c619a; no voters: ad1372223cdf46268adb3c30eca95f7d, b1d431af95f44392be9a7897aa337763
I20260810 01:39:44.794234 17626 raft_consensus.cc:2726] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:39:44.975322 17627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:44.974890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:44343)
0810 01:39:44.975175 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:44.975232 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":103,"threads_started":1}
I20260810 01:39:45.647485 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:45.647047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:40175)
0810 01:39:45.647325 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:45.647386 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":87,"threads_started":1}
I20260810 01:39:45.785817 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:45.785327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:40301)
0810 01:39:45.785641 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:45.785712 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":86,"threads_started":1}
I20260810 01:39:45.976842 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:45.976348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:49039)
0810 01:39:45.976673 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:45.976745 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":91,"threads_started":1}
I20260810 01:39:46.648774 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:46.648325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:56607)
0810 01:39:46.648616 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:46.648676 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":100,"threads_started":1}
I20260810 01:39:46.787247 17638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:46.786754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:54475)
0810 01:39:46.787093 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:46.787151 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":89,"threads_started":1}
I20260810 01:39:46.978130 17639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:46.977657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:37995)
0810 01:39:46.977957 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:46.978013 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":73,"threads_started":1}
I20260810 01:39:47.650166 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:47.649660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:48785)
0810 01:39:47.649984 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:47.650060 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":88,"threads_started":1}
I20260810 01:39:47.788568 17642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:47.788132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:53665)
0810 01:39:47.788399 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:47.788459 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":77,"threads_started":1}
I20260810 01:39:47.979372 17644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:47.978936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:43923)
0810 01:39:47.979209 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:47.979267 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
I20260810 01:39:48.651666 17646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:48.651171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:47173)
0810 01:39:48.651495 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:48.651563 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":86,"threads_started":1}
I20260810 01:39:48.789901 17647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:48.789424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:49959)
0810 01:39:48.789724 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:48.789788 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":84,"threads_started":1}
I20260810 01:39:48.980685 17649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:48.980242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:40847)
0810 01:39:48.980516 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:48.980587 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":77,"threads_started":1}
I20260810 01:39:49.180387 17652 raft_consensus.cc:482] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:49.180526 17652 raft_consensus.cc:504] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1d431af95f44392be9a7897aa337763" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 46353 } } peers { permanent_uuid: "ad1372223cdf46268adb3c30eca95f7d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36655 } } peers { permanent_uuid: "cefa6ac152044dee99e5fe3c4b7c619a" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43511 } }
I20260810 01:39:49.180929 17652 leader_election.cc:288] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353), ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655)
W20260810 01:39:49.181828 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1d431af95f44392be9a7897aa337763 (127.24.205.131:46353): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
W20260810 01:39:49.181999 16923 leader_election.cc:341] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad1372223cdf46268adb3c30eca95f7d (127.24.205.130:36655): Not found: Tablet not found: 8362f8c794574717a9de68e0dd25565b
I20260810 01:39:49.182075 16923 leader_election.cc:302] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cefa6ac152044dee99e5fe3c4b7c619a; no voters: ad1372223cdf46268adb3c30eca95f7d, b1d431af95f44392be9a7897aa337763
I20260810 01:39:49.182258 17652 raft_consensus.cc:2726] T 8362f8c794574717a9de68e0dd25565b P cefa6ac152044dee99e5fe3c4b7c619a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:39:49.653085 17653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:49.652635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:56419)
0810 01:39:49.652908 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:49.652967 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
I20260810 01:39:49.791234 17655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:49.790784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:48283)
0810 01:39:49.791074 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:49.791134 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":87,"threads_started":1}
I20260810 01:39:49.981856 17657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:49.981454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:45243)
0810 01:39:49.981717 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:49.981769 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":93,"threads_started":1}
I20260810 01:39:50.654613 17658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:50.654030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:41085)
0810 01:39:50.654385 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:50.654465 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":87,"threads_started":1}
I20260810 01:39:50.792711 17659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:50.792238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:58427)
0810 01:39:50.792544 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:50.792608 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":97,"threads_started":1}
I20260810 01:39:50.983161 17660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:50.982669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:41365)
0810 01:39:50.982960 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:50.983035 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":75,"threads_started":1}
I20260810 01:39:51.655972 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:51.655448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:58103)
0810 01:39:51.655795 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:51.655870 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":127,"threads_started":1}
I20260810 01:39:51.794178 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:51.793709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:43185)
0810 01:39:51.794029 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:51.794082 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":105,"threads_started":1}
I20260810 01:39:51.984580 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:51.984043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:46617)
0810 01:39:51.984413 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:51.984477 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":84,"threads_started":1}
I20260810 01:39:52.657173 17669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:52.656746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:51749)
0810 01:39:52.657012 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:52.657069 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":89,"threads_started":1}
I20260810 01:39:52.795516 17670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:52.795002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:42431)
0810 01:39:52.795336 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:52.795410 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":93,"threads_started":1}
I20260810 01:39:52.986079 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:52.985542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:48209)
0810 01:39:52.985859 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:52.985912 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":82,"threads_started":1}
I20260810 01:39:53.658411 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:53.657987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:40623)
0810 01:39:53.658252 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:53.658308 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":81,"threads_started":1}
I20260810 01:39:53.796795 17676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:53.796349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:45999)
0810 01:39:53.796632 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:53.796691 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":98,"threads_started":1}
I20260810 01:39:53.987289 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:53.986869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:46923)
0810 01:39:53.987129 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:53.987188 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
I20260810 01:39:54.659924 17678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:54.659477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.129:39233)
0810 01:39:54.659757 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:54.659822 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":80,"threads_started":1}
I20260810 01:39:54.798125 17680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:54.797706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.130:39311)
0810 01:39:54.797962 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:54.798014 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":86,"threads_started":1}
I20260810 01:39:54.970242 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 16843
I20260810 01:39:54.985064 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 17139
I20260810 01:39:54.992690 17683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:54.991352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46609 (local address 127.24.205.131:52475)
0810 01:39:54.992525 (+ 1173us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:54.992584 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:46609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1082,"thread_start_us":953,"threads_started":1}
I20260810 01:39:54.998478 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 17375
2026-08-10T01:39:55Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19643 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:39:55 dist-test-slave-t3q3 krb5kdc[17687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:39:55 dist-test-slave-t3q3 krb5kdc[17687](info): set up 2 sockets
Aug 10 01:39:55 dist-test-slave-t3q3 krb5kdc[17687](info): commencing operation
krb5kdc: starting...
W20260810 01:39:56.298488 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:39:56 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:39:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:39:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:39:56.436151 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41559
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:56.551645 17707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:56.551939 17707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:56.551980 17707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:56.556104 17707 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 01:39:56.556174 17707 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 01:39:56.556190 17707 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 01:39:56.556203 17707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:39:56.556222 17707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:56.556262 17707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:56.556278 17707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:39:56.556293 17707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:39:56.561697 17707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:56.562767 17707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:56.563881 17707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:56.573030 17716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:56.573163 17707 server_base.cc:1034] running on GCE node
W20260810 01:39:56.573143 17718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:56.573143 17715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:56.573989 17707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:56.575145 17707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:56.576344 17707 hybrid_clock.cc:648] HybridClock initialized: now 1786325996576330 us; error 25 us; skew 500 ppm
Aug 10 01:39:56 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325996, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:56.579111 17707 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:39:56.580003 17707 webserver.cc:460] Webserver started at http://127.24.205.190:40529/ using document root <none> and password file <none>
I20260810 01:39:56.580621 17707 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:56.580737 17707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:56.580978 17707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:56.583109 17707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "5f20af04d5234da29f04a40058c17268"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "4563bb5656465771f0cf09824b60084d"
server_key_iv: "01b0fe747dd082aa845af70497571528"
server_key_version: "encryptionkey@0"
I20260810 01:39:56.583834 17707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "5f20af04d5234da29f04a40058c17268"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "4563bb5656465771f0cf09824b60084d"
server_key_iv: "01b0fe747dd082aa845af70497571528"
server_key_version: "encryptionkey@0"
I20260810 01:39:56.588047 17707 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260810 01:39:56.590782 17731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:56.592156 17707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 01:39:56.592303 17707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "5f20af04d5234da29f04a40058c17268"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "4563bb5656465771f0cf09824b60084d"
server_key_iv: "01b0fe747dd082aa845af70497571528"
server_key_version: "encryptionkey@0"
I20260810 01:39:56.592427 17707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:56.607230 17707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:56.610373 17707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:56.610587 17707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:56.618041 17707 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:41559
I20260810 01:39:56.618383 17808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:41559 every 8 connection(s)
I20260810 01:39:56.619131 17707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:39:56.621969 17809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:56.624189 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 17707
I20260810 01:39:56.624320 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:39:56.624636 25398 external_mini_cluster.cc:1428] Setting key 6f49917c7c6c7d5bdae523a8614a2267
I20260810 01:39:56.628875 17809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Bootstrap starting.
I20260810 01:39:56.631108 17809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:56.631942 17809 log.cc:824] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:39:56 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:56.634156 17809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: No bootstrap required, opened a new log
I20260810 01:39:56.638505 17809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:39:56.638772 17809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:56.638859 17809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20af04d5234da29f04a40058c17268, State: Initialized, Role: FOLLOWER
I20260810 01:39:56.639132 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:56.626097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53688 (local address 127.24.205.190:41559)
0810 01:39:56.626517 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:56.626532 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:56.626567 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:39:56.627201 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:56.627218 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:56.627531 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:56.627876 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:56.628767 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:56.629799 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:56.630694 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:56.631206 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:56.631392 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:56.634182 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:56.634188 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:56.634201 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:56.634227 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:56.635962 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:56.636444 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:56.636454 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:56.636458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:56.636566 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:56.636862 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:56.636865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:56.636866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:56.637290 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:56.637498 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:56.637932 (+ 434us) server_negotiation.cc:299] Negotiation successful
0810 01:39:56.638272 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":121,"threads_started":1}
I20260810 01:39:56.639366 17809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:39:56.639528 17809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:39:56.639602 17809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:39:56.639699 17809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:56.640702 17809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:39:56.641053 17809 leader_election.cc:302] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f20af04d5234da29f04a40058c17268; no voters:
I20260810 01:39:56.641400 17809 leader_election.cc:288] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:39:56.641512 17818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:56.641799 17818 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 LEADER]: Becoming Leader. State: Replica: 5f20af04d5234da29f04a40058c17268, State: Running, Role: LEADER
I20260810 01:39:56.642134 17818 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:39:56.642827 17809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:39:56.643824 17822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f20af04d5234da29f04a40058c17268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } } }
I20260810 01:39:56.643779 17819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f20af04d5234da29f04a40058c17268. Latest consensus state: current_term: 1 leader_uuid: "5f20af04d5234da29f04a40058c17268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } } }
I20260810 01:39:56.643956 17822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:56.643956 17819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: This master's current role is: LEADER
I20260810 01:39:56.644481 17836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:39:56.647819 17836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:39:56.653728 17836 catalog_manager.cc:1347] Generated new cluster ID: 540891e7d31f4b1d8396343b5a8cebee
I20260810 01:39:56.653800 17836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:39:56.667480 17836 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:39:56.668774 17836 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:39:56.676321 17836 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Generated new TSK 0
I20260810 01:39:56.677204 17836 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:39:56.717594 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41559
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:56.842593 17853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:56.842844 17853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:56.842885 17853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:56.847121 17853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:56.847186 17853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:56.847280 17853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:39:56.852602 17853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:56.853732 17853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:56.854817 17853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:56.864691 17864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:56.864678 17869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:56.864933 17853 server_base.cc:1034] running on GCE node
W20260810 01:39:56.864732 17866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:56.865525 17853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:56.866227 17853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:56.867436 17853 hybrid_clock.cc:648] HybridClock initialized: now 1786325996867418 us; error 33 us; skew 500 ppm
Aug 10 01:39:56 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325996, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:56.870446 17853 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:39:56.871294 17853 webserver.cc:460] Webserver started at http://127.24.205.129:41129/ using document root <none> and password file <none>
I20260810 01:39:56.871840 17853 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:56.871898 17853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:56.872131 17853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:56.874230 17853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "c1beda4213c24f468c93ecf19f271ae0"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "f149c1f0c1c020fe45a48585ad646f26"
server_key_iv: "8bc6bdd041aae2f74207ac2e164284f7"
server_key_version: "encryptionkey@0"
I20260810 01:39:56.874764 17853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "c1beda4213c24f468c93ecf19f271ae0"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "f149c1f0c1c020fe45a48585ad646f26"
server_key_iv: "8bc6bdd041aae2f74207ac2e164284f7"
server_key_version: "encryptionkey@0"
I20260810 01:39:56.878453 17853 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:39:56.880853 17879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:56.882103 17853 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:39:56.882200 17853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "c1beda4213c24f468c93ecf19f271ae0"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "f149c1f0c1c020fe45a48585ad646f26"
server_key_iv: "8bc6bdd041aae2f74207ac2e164284f7"
server_key_version: "encryptionkey@0"
I20260810 01:39:56.882283 17853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:56.893282 17853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:56.896283 17853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:56.896435 17853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:56.897001 17853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:56.897830 17853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:56.897876 17853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:56.897915 17853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:56.897930 17853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:56.906491 17853 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:41693
I20260810 01:39:56.906589 18069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:41693 every 8 connection(s)
I20260810 01:39:56.907424 17853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:39:56.915163 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 17853
I20260810 01:39:56.915315 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:39:56.915657 25398 external_mini_cluster.cc:1428] Setting key db63ebdaebea0ad46f8eafaf874e450c
Aug 10 01:39:56 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325996, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:56.922758 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:56.909358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:35317 (local address 127.24.205.190:41559)
0810 01:39:56.909513 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:56.909518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:56.910443 (+ 925us) server_negotiation.cc:407] Connection header received
0810 01:39:56.911730 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:56.911733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:56.911782 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:56.911858 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:56.913174 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:56.913713 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:56.914921 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:56.915274 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:56.915387 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:56.918570 (+ 3183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:56.918578 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:56.918580 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:56.918605 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:56.920439 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:56.920977 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:56.920983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:56.920987 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:56.921092 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:56.921429 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:56.921435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:56.921440 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:56.921718 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:56.921829 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:56.922348 (+ 519us) server_negotiation.cc:299] Negotiation successful
0810 01:39:56.922504 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:39:56.923535 18074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:56.909808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:35317)
0810 01:39:56.910282 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:56.910328 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:56.911497 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:56.912044 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:56.912051 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:56.912497 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:56.913032 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:56.913048 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:56.913834 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:56.913837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:56.914771 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:56.914781 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:56.915472 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:56.915475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:56.915640 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:56.916389 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:56.916405 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:56.918375 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:56.920561 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:56.920566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:56.920579 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:56.920870 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:56.921180 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:56.921182 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:56.921183 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:56.921331 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:56.921827 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:56.921832 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:56.922080 (+ 248us) client_negotiation.cc:769] Sending connection context
0810 01:39:56.922256 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 01:39:56.922528 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":113,"threads_started":1}
I20260810 01:39:56.924947 18071 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41559
I20260810 01:39:56.925203 18071 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:56.925732 18071 heartbeater.cc:511] Master 127.24.205.190:41559 requested a full tablet report, sending...
I20260810 01:39:56.927337 17760 ts_manager.cc:194] Registered new tserver with Master: c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129:41693)
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:39:56.928712 17760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:35317
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:39:56.948047 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41559
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:57.063289 18079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:57.063577 18079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:57.063661 18079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:57.067692 18079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:57.067785 18079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:57.067875 18079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:39:57.073163 18079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:57.074229 18079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:57.075280 18079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:57.084973 18087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:57.084950 18089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:57.084988 18094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:57.085501 18079 server_base.cc:1034] running on GCE node
I20260810 01:39:57.085937 18079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:57.086642 18079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:57.087865 18079 hybrid_clock.cc:648] HybridClock initialized: now 1786325997087828 us; error 46 us; skew 500 ppm
Aug 10 01:39:57 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325997, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:57.090847 18079 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:39:57.091828 18079 webserver.cc:460] Webserver started at http://127.24.205.130:39463/ using document root <none> and password file <none>
I20260810 01:39:57.092502 18079 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:57.092605 18079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:57.092829 18079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:57.094969 18079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "0322282ead2f4fc398ca6561bd2eb635"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "861e221660190c49d2cc7621a1abc9fb"
server_key_iv: "87b43fe6f623187d03444221e596e90b"
server_key_version: "encryptionkey@0"
I20260810 01:39:57.095584 18079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "0322282ead2f4fc398ca6561bd2eb635"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "861e221660190c49d2cc7621a1abc9fb"
server_key_iv: "87b43fe6f623187d03444221e596e90b"
server_key_version: "encryptionkey@0"
I20260810 01:39:57.099624 18079 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:39:57.102152 18106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:57.103436 18079 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 01:39:57.103608 18079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "0322282ead2f4fc398ca6561bd2eb635"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "861e221660190c49d2cc7621a1abc9fb"
server_key_iv: "87b43fe6f623187d03444221e596e90b"
server_key_version: "encryptionkey@0"
I20260810 01:39:57.103734 18079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:57.118927 18079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:57.121798 18079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:57.122020 18079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:57.122581 18079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:57.123459 18079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:57.123543 18079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:57.123616 18079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:57.123653 18079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:57.132740 18079 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36259
I20260810 01:39:57.132771 18295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36259 every 8 connection(s)
I20260810 01:39:57.133651 18079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:39:57.135658 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 18079
I20260810 01:39:57.135808 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:39:57.136222 25398 external_mini_cluster.cc:1428] Setting key ac34083c4a332663f8e65c0b8b81e3d1
Aug 10 01:39:57 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325997, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:39:57.149547 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.135536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:43625 (local address 127.24.205.190:41559)
0810 01:39:57.135709 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.135714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.136612 (+ 898us) server_negotiation.cc:407] Connection header received
0810 01:39:57.138077 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.138082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.138133 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.138245 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:57.139389 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.139974 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.141846 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.142074 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.142163 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.145480 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:57.145484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:57.145487 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:57.145527 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:57.147136 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:57.147769 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:57.147772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:57.147774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:57.147863 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:57.148305 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:57.148308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:57.148310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:57.148608 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:57.148714 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.149239 (+ 525us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.149371 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 01:39:57.150373 18300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.135946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:43625)
0810 01:39:57.136436 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.136488 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:57.137868 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:57.138386 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:57.138393 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:57.138770 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:57.139241 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.139254 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.140196 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.140201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.141698 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.141713 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.142244 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.142251 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.142489 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.143182 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:57.143248 (+ 66us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:57.145290 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:57.147277 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:57.147282 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:57.147297 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:57.147648 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:57.147965 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:57.147969 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:57.147971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:57.148195 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:57.148711 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:57.148717 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:57.148980 (+ 263us) client_negotiation.cc:769] Sending connection context
0810 01:39:57.149180 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 01:39:57.149511 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":137,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:39:57.151716 18298 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41559
I20260810 01:39:57.151981 18298 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:57.152521 18298 heartbeater.cc:511] Master 127.24.205.190:41559 requested a full tablet report, sending...
I20260810 01:39:57.153699 17760 ts_manager.cc:194] Registered new tserver with Master: 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
I20260810 01:39:57.154330 17760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:43625
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:39:57.167404 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41559
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:39:57.300411 18304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:39:57.300710 18304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:39:57.300806 18304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:39:57.305475 18304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:39:57.305552 18304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:39:57.305660 18304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:39:57.311800 18304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:39:57.313012 18304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:39:57.314133 18304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:39:57.324580 18309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:57.324708 18304 server_base.cc:1034] running on GCE node
W20260810 01:39:57.324666 18315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:39:57.324868 18311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:39:57.325320 18304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:39:57.325982 18304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:39:57.327178 18304 hybrid_clock.cc:648] HybridClock initialized: now 1786325997327155 us; error 30 us; skew 500 ppm
Aug 10 01:39:57 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325997, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:39:57.330210 18304 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:39:57.331176 18304 webserver.cc:460] Webserver started at http://127.24.205.131:36825/ using document root <none> and password file <none>
I20260810 01:39:57.331769 18304 fs_manager.cc:359] Metadata directory not provided
I20260810 01:39:57.331868 18304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:39:57.332203 18304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:39:57.334316 18304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "962a707e213643c6b945d90314f27810"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "77a0c91172ee72ed4f7c87e6c9925994"
server_key_iv: "bb12af1e26570d26fc32f79b24bf3d1a"
server_key_version: "encryptionkey@0"
I20260810 01:39:57.334946 18304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "962a707e213643c6b945d90314f27810"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "77a0c91172ee72ed4f7c87e6c9925994"
server_key_iv: "bb12af1e26570d26fc32f79b24bf3d1a"
server_key_version: "encryptionkey@0"
I20260810 01:39:57.338786 18304 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:39:57.341356 18327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:57.342684 18304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:39:57.342824 18304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "962a707e213643c6b945d90314f27810"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "77a0c91172ee72ed4f7c87e6c9925994"
server_key_iv: "bb12af1e26570d26fc32f79b24bf3d1a"
server_key_version: "encryptionkey@0"
I20260810 01:39:57.342947 18304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:39:57.354790 18304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:39:57.357841 18304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:39:57.358064 18304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:39:57.358691 18304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:39:57.359550 18304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:39:57.359630 18304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:57.359704 18304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:39:57.359753 18304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:39:57.369855 18304 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:40613
I20260810 01:39:57.369932 18524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:40613 every 8 connection(s)
I20260810 01:39:57.370877 18304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:39:57.375675 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 18304
I20260810 01:39:57.375824 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:39:57.376163 25398 external_mini_cluster.cc:1428] Setting key 5d8ae33b58c458c76556adcce3b873be
Aug 10 01:39:57 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786325997, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:39:57.386756 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.373192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:43851 (local address 127.24.205.190:41559)
0810 01:39:57.373392 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.373397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.374318 (+ 921us) server_negotiation.cc:407] Connection header received
0810 01:39:57.375614 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.375620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.375689 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.375809 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:57.377363 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.378182 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.379486 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.379748 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.379864 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.382563 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:57.382566 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:57.382568 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:57.382593 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:57.384236 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:57.384913 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:57.384919 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:57.384922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:57.385074 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:57.385510 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:57.385514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:57.385518 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:57.385757 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:57.385838 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.386531 (+ 693us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.386636 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260810 01:39:57.387645 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.373620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:43851)
0810 01:39:57.374141 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.374185 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:57.375363 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:57.376038 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:57.376045 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:57.376592 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:39:57.377190 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.377210 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.378332 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.378335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.379349 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.379359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.379904 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.379906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.380048 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.380792 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:39:57.380808 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:39:57.382395 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:39:57.384343 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:57.384352 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:57.384369 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:57.384801 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:57.385190 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:39:57.385196 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:39:57.385201 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:39:57.385390 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:39:57.385866 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:39:57.385874 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:39:57.386256 (+ 382us) client_negotiation.cc:769] Sending connection context
0810 01:39:57.386485 (+ 229us) client_negotiation.cc:240] Negotiation successful
0810 01:39:57.386754 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":125,"threads_started":1}
I20260810 01:39:57.388916 18526 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41559
I20260810 01:39:57.389425 18526 heartbeater.cc:464] Registering TS with master...
I20260810 01:39:57.389966 18526 heartbeater.cc:511] Master 127.24.205.190:41559 requested a full tablet report, sending...
I20260810 01:39:57.390998 17760 ts_manager.cc:194] Registered new tserver with Master: 962a707e213643c6b945d90314f27810 (127.24.205.131:40613)
I20260810 01:39:57.391548 17760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:43851
I20260810 01:39:57.402683 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:39:57.413450 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.404860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53700 (local address 127.24.205.190:41559)
0810 01:39:57.405121 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.405127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.405334 (+ 207us) server_negotiation.cc:407] Connection header received
0810 01:39:57.405501 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.405504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.405562 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.405653 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:39:57.406569 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.407140 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.408200 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.408563 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.408675 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.410123 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:39:57.410126 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:39:57.410129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:39:57.410153 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:39:57.411719 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:57.412164 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:57.412166 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:57.412168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:57.412262 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:39:57.412522 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:39:57.412524 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:39:57.412525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:39:57.412759 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:39:57.412869 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.413112 (+ 243us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.413232 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260810 01:39:57.416783 17760 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53700:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:39:57.419947 17760 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:39:57.435036 18550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.428545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40613 (local address 127.0.0.1:55394)
0810 01:39:57.429705 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.429718 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:57.429801 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:57.430440 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:57.430445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:57.430466 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:57.430561 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.430567 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.431601 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.431604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.433133 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.433146 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.434478 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.434482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.434591 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.434636 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 01:39:57.434753 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 01:39:57.434877 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"mutex_wait_us":67,"thread_start_us":92,"threads_started":1}
I20260810 01:39:57.435359 18553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.429240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:41693 (local address 127.0.0.1:36878)
0810 01:39:57.429983 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.429995 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:57.430066 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:57.430645 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:57.430648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:57.430666 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:57.430761 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.430768 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.432154 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.432158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.433743 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.433754 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.434959 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.434963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.435042 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.435079 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 01:39:57.435152 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:39:57.435243 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":96,"threads_started":1}
I20260810 01:39:57.435405 18552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.428581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37902 (local address 127.24.205.130:36259)
0810 01:39:57.429028 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.429040 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.429067 (+ 27us) server_negotiation.cc:407] Connection header received
0810 01:39:57.429319 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.429326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.429548 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.429712 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:57.430241 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.431411 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.433397 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.434321 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.434450 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.434587 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.435134 (+ 547us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.435260 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":127,"threads_started":1}
I20260810 01:39:57.436316 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.429297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55394 (local address 127.24.205.131:40613)
0810 01:39:57.429971 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.429985 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.430008 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:39:57.430083 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.430088 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.430282 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.430452 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:57.430660 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.431457 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.433280 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.434161 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.434280 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.434411 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.436002 (+ 1591us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.436145 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":148,"threads_started":1}
I20260810 01:39:57.435894 18548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.428452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36259 (local address 127.0.0.1:37902)
0810 01:39:57.428909 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.428958 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:57.429088 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:57.429927 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:57.429933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:57.429955 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:57.430106 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.430116 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.431567 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.431572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.433235 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.433247 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.434664 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.434668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.434785 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.434819 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 01:39:57.434899 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 01:39:57.434978 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":114,"thread_start_us":92,"threads_started":1}
I20260810 01:39:57.437325 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.429535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36878 (local address 127.24.205.129:41693)
0810 01:39:57.430098 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.430104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.430123 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:39:57.430185 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.430189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.430334 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.430499 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:57.430897 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.431980 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.433883 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.434662 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.434783 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.434896 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.435869 (+ 973us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.435998 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":130,"threads_started":1}
I20260810 01:39:57.439282 18421 tablet_service.cc:1467] Processing CreateTablet for tablet 37485094a18c4d57947d324af9905423 (DEFAULT_TABLE table=test-table [id=00ee7e795c674959986d97ef413a4149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:57.439586 17955 tablet_service.cc:1467] Processing CreateTablet for tablet 37485094a18c4d57947d324af9905423 (DEFAULT_TABLE table=test-table [id=00ee7e795c674959986d97ef413a4149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:57.440550 18421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37485094a18c4d57947d324af9905423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:57.440641 17955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37485094a18c4d57947d324af9905423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:57.441882 18188 tablet_service.cc:1467] Processing CreateTablet for tablet 37485094a18c4d57947d324af9905423 (DEFAULT_TABLE table=test-table [id=00ee7e795c674959986d97ef413a4149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:39:57.442927 18188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37485094a18c4d57947d324af9905423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:39:57.448021 18559 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap starting.
I20260810 01:39:57.448647 18558 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Bootstrap starting.
I20260810 01:39:57.450341 18561 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Bootstrap starting.
I20260810 01:39:57.450816 18559 tablet_bootstrap.cc:654] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:57.451254 18558 tablet_bootstrap.cc:654] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:57.451848 18559 log.cc:824] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:57.452135 18558 log.cc:824] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:57.453147 18561 tablet_bootstrap.cc:654] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Neither blocks nor log segments found. Creating new log.
I20260810 01:39:57.453917 18559 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: No bootstrap required, opened a new log
I20260810 01:39:57.453955 18561 log.cc:824] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Log is configured to *not* fsync() on all Append() calls
I20260810 01:39:57.454144 18559 ts_tablet_manager.cc:1397] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260810 01:39:57.454219 18558 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: No bootstrap required, opened a new log
I20260810 01:39:57.454452 18558 ts_tablet_manager.cc:1397] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:39:57.456022 18561 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: No bootstrap required, opened a new log
I20260810 01:39:57.456272 18561 ts_tablet_manager.cc:1397] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260810 01:39:57.458318 18559 raft_consensus.cc:348] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.458570 18559 raft_consensus.cc:374] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:57.458647 18559 raft_consensus.cc:729] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1beda4213c24f468c93ecf19f271ae0, State: Initialized, Role: FOLLOWER
I20260810 01:39:57.458560 18558 raft_consensus.cc:348] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.458837 18558 raft_consensus.cc:374] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:57.458894 18558 raft_consensus.cc:729] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 962a707e213643c6b945d90314f27810, State: Initialized, Role: FOLLOWER
I20260810 01:39:57.459189 18559 consensus_queue.cc:260] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.459322 18558 consensus_queue.cc:260] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.460037 18526 heartbeater.cc:503] Master 127.24.205.190:41559 was elected leader, sending a full tablet report...
I20260810 01:39:57.460351 18558 ts_tablet_manager.cc:1428] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:39:57.460455 18071 heartbeater.cc:503] Master 127.24.205.190:41559 was elected leader, sending a full tablet report...
I20260810 01:39:57.460167 18561 raft_consensus.cc:348] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.461398 18561 raft_consensus.cc:374] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:39:57.461510 18561 raft_consensus.cc:729] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0322282ead2f4fc398ca6561bd2eb635, State: Initialized, Role: FOLLOWER
I20260810 01:39:57.461923 18561 consensus_queue.cc:260] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.462563 18298 heartbeater.cc:503] Master 127.24.205.190:41559 was elected leader, sending a full tablet report...
I20260810 01:39:57.462899 18561 ts_tablet_manager.cc:1428] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260810 01:39:57.461282 18559 ts_tablet_manager.cc:1428] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
W20260810 01:39:57.621919 18530 tablet.cc:2369] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:39:57.634809 18299 tablet.cc:2369] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:39:57.658946 18072 tablet.cc:2369] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:39:57.730130 18574 raft_consensus.cc:482] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:39:57.730398 18574 raft_consensus.cc:504] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.731611 18574 leader_election.cc:288] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129:41693)
I20260810 01:39:57.735648 18575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.731925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:41693 (local address 127.24.205.130:60603)
0810 01:39:57.732244 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.732263 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:57.732431 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:57.732733 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:57.732736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:57.732755 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:57.732885 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.732890 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.733652 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.733656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.734517 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.734528 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.735191 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.735195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.735296 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.735320 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:39:57.735414 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 01:39:57.735487 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":23,"thread_start_us":128,"threads_started":1}
I20260810 01:39:57.735633 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.732137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:60603 (local address 127.24.205.129:41693)
0810 01:39:57.732263 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.732269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.732356 (+ 87us) server_negotiation.cc:407] Connection header received
0810 01:39:57.732579 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.732582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.732628 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.732716 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:57.733008 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.733533 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.734648 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.735062 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.735194 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.735249 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.735431 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.735502 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:39:57.735782 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.732159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:36153 (local address 127.24.205.131:40613)
0810 01:39:57.732290 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.732294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.732668 (+ 374us) server_negotiation.cc:407] Connection header received
0810 01:39:57.732822 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.732826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.732873 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.732957 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:39:57.733247 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.733739 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.734804 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.735213 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.735339 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.735395 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.735614 (+ 219us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.735681 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:39:57.735798 18576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.731925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40613 (local address 127.24.205.130:36153)
0810 01:39:57.732570 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.732582 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:39:57.732712 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:39:57.732969 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:39:57.732981 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:39:57.732997 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:39:57.733128 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.733134 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.733856 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.733860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.734680 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:39:57.734690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.735336 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.735340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:39:57.735453 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.735479 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:39:57.735578 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 01:39:57.735652 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":413,"thread_start_us":76,"threads_started":1}
I20260810 01:39:57.736590 18450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37485094a18c4d57947d324af9905423" candidate_uuid: "0322282ead2f4fc398ca6561bd2eb635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "962a707e213643c6b945d90314f27810" is_pre_election: true
I20260810 01:39:57.736608 17992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37485094a18c4d57947d324af9905423" candidate_uuid: "0322282ead2f4fc398ca6561bd2eb635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1beda4213c24f468c93ecf19f271ae0" is_pre_election: true
I20260810 01:39:57.736925 18450 raft_consensus.cc:2454] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0322282ead2f4fc398ca6561bd2eb635 in term 0.
I20260810 01:39:57.736938 17992 raft_consensus.cc:2454] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0322282ead2f4fc398ca6561bd2eb635 in term 0.
I20260810 01:39:57.737442 18115 leader_election.cc:302] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810, c1beda4213c24f468c93ecf19f271ae0; no voters:
I20260810 01:39:57.737735 18574 raft_consensus.cc:2781] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:39:57.737824 18574 raft_consensus.cc:482] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:39:57.737869 18574 raft_consensus.cc:3037] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:57.738932 18574 raft_consensus.cc:504] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.739270 18574 leader_election.cc:288] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [CANDIDATE]: Term 1 election: Requested vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129:41693)
I20260810 01:39:57.739657 18450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37485094a18c4d57947d324af9905423" candidate_uuid: "0322282ead2f4fc398ca6561bd2eb635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "962a707e213643c6b945d90314f27810"
I20260810 01:39:57.739648 17992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37485094a18c4d57947d324af9905423" candidate_uuid: "0322282ead2f4fc398ca6561bd2eb635" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1beda4213c24f468c93ecf19f271ae0"
I20260810 01:39:57.739764 18450 raft_consensus.cc:3037] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:57.739795 17992 raft_consensus.cc:3037] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:39:57.740890 18450 raft_consensus.cc:2454] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0322282ead2f4fc398ca6561bd2eb635 in term 1.
I20260810 01:39:57.741010 17992 raft_consensus.cc:2454] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0322282ead2f4fc398ca6561bd2eb635 in term 1.
I20260810 01:39:57.741302 18117 leader_election.cc:302] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810; no voters:
I20260810 01:39:57.741474 18574 raft_consensus.cc:2781] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:39:57.741711 18574 raft_consensus.cc:686] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 LEADER]: Becoming Leader. State: Replica: 0322282ead2f4fc398ca6561bd2eb635, State: Running, Role: LEADER
I20260810 01:39:57.742079 18574 consensus_queue.cc:237] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:39:57.745455 17758 catalog_manager.cc:5495] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "0322282ead2f4fc398ca6561bd2eb635" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } health_report { overall_health: UNKNOWN } } }
I20260810 01:39:57.797739 18552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.794073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37910 (local address 127.24.205.130:36259)
0810 01:39:57.794217 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 01:39:57.794224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:39:57.794242 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:39:57.794334 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:39:57.794337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:39:57.794392 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:39:57.794536 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:39:57.794794 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.795307 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.796263 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:39:57.796497 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:39:57.796612 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:39:57.796925 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:39:57.797347 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:39:57.797495 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 01:39:57.797533 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 01:39:57.797592 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:39:57.803628 17992 raft_consensus.cc:1261] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Refusing update from remote peer 0322282ead2f4fc398ca6561bd2eb635: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:57.803628 18450 raft_consensus.cc:1261] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Refusing update from remote peer 0322282ead2f4fc398ca6561bd2eb635: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:39:57.804415 18574 consensus_queue.cc:1035] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [LEADER]: Connected to new peer: Peer: permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:57.804648 18578 consensus_queue.cc:1035] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:39:57.814224 18583 mvcc.cc:205] Tried to move back new op lower bound from 7316791286995718144 to 7316791286754754560. Current Snapshot: MvccSnapshot[applied={T|T < 7316791286995718144}]
I20260810 01:39:57.814568 18584 mvcc.cc:205] Tried to move back new op lower bound from 7316791286995718144 to 7316791286754754560. Current Snapshot: MvccSnapshot[applied={T|T < 7316791286995718144 or (T in {7316791286995718144})}]
I20260810 01:39:57.821362 17758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:57.821509 17758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:39:57.824030 17758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Sending DeleteTablet for 3 replicas of tablet 37485094a18c4d57947d324af9905423
I20260810 01:39:57.824887 18421 tablet_service.cc:1514] Processing DeleteTablet for tablet 37485094a18c4d57947d324af9905423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:57 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:55394
I20260810 01:39:57.824920 18188 tablet_service.cc:1514] Processing DeleteTablet for tablet 37485094a18c4d57947d324af9905423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:57 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:37902
I20260810 01:39:57.824958 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 17853
I20260810 01:39:57.831286 18598 tablet_replica.cc:330] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: stopping tablet replica
I20260810 01:39:57.831669 18598 raft_consensus.cc:2229] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:39:57.832008 18598 raft_consensus.cc:2258] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:57.834313 18598 ts_tablet_manager.cc:1905] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:57.836934 18598 ts_tablet_manager.cc:1918] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:57.837044 18598 log.cc:1196] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/37485094a18c4d57947d324af9905423
I20260810 01:39:57.837352 18598 ts_tablet_manager.cc:1939] T 37485094a18c4d57947d324af9905423 P 962a707e213643c6b945d90314f27810: Deleting consensus metadata
I20260810 01:39:57.838580 18600 tablet_replica.cc:330] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: stopping tablet replica
I20260810 01:39:57.838681 17737 catalog_manager.cc:4841] TS 962a707e213643c6b945d90314f27810 (127.24.205.131:40613): tablet 37485094a18c4d57947d324af9905423 (table test-table [id=00ee7e795c674959986d97ef413a4149]) successfully deleted
I20260810 01:39:57.838913 18600 raft_consensus.cc:2229] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:39:57.839269 18600 raft_consensus.cc:2258] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:39:57.842075 18600 ts_tablet_manager.cc:1905] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:39:57.845089 18600 ts_tablet_manager.cc:1918] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:39:57.845201 18600 log.cc:1196] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/37485094a18c4d57947d324af9905423
I20260810 01:39:57.845525 18600 ts_tablet_manager.cc:1939] T 37485094a18c4d57947d324af9905423 P 0322282ead2f4fc398ca6561bd2eb635: Deleting consensus metadata
I20260810 01:39:57.846827 17735 catalog_manager.cc:4841] TS 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259): tablet 37485094a18c4d57947d324af9905423 (table test-table [id=00ee7e795c674959986d97ef413a4149]) successfully deleted
W20260810 01:39:57.849251 17735 connection.cc:535] client connection to 127.24.205.129:41693 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 01:39:57.849401 17735 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:39:57.849447 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 18079
I20260810 01:39:57.858779 18553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:39:57.858397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:41693 (local address 127.0.0.1:36888)
0810 01:39:57.858600 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 01:39:57.858678 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:41693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260810 01:39:57.858979 17735 catalog_manager.cc:4584] TS c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129:41693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 37485094a18c4d57947d324af9905423: Network error: Client connection negotiation failed: client connection to 127.24.205.129:41693: connect: Connection refused (error 111)
I20260810 01:39:57.865806 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 18304
I20260810 01:39:57.876632 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 17707
I20260810 01:40:17.888363 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41559
--webserver_interface=127.24.205.190
--webserver_port=40529
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:40:18.008271 18602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:18.008534 18602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:18.008574 18602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:18.012547 18602 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 01:40:18.012589 18602 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 01:40:18.012605 18602 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 01:40:18.012619 18602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:40:18.012679 18602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:18.012714 18602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:18.012756 18602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:40:18.012807 18602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:40:18.018096 18602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=40529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:18.019183 18602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:18.020251 18602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:18.035020 18618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:18.035176 18614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:18.035322 18602 server_base.cc:1034] running on GCE node
W20260810 01:40:18.035359 18613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:18.036443 18602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:18.037828 18602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:18.039069 18602 hybrid_clock.cc:648] HybridClock initialized: now 1786326018039060 us; error 44 us; skew 500 ppm
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:18.042251 18602 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:40:18.043213 18602 webserver.cc:460] Webserver started at http://127.24.205.190:40529/ using document root <none> and password file <none>
I20260810 01:40:18.043906 18602 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:18.044111 18602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:18.048413 18602 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 01:40:18.050733 18630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.052364 18602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:40:18.052520 18602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "5f20af04d5234da29f04a40058c17268"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "4563bb5656465771f0cf09824b60084d"
server_key_iv: "01b0fe747dd082aa845af70497571528"
server_key_version: "encryptionkey@0"
I20260810 01:40:18.053180 18602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:18.066397 18602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:18.069550 18602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:18.069778 18602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:18.077132 18602 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:41559
I20260810 01:40:18.077446 18722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:41559 every 8 connection(s)
I20260810 01:40:18.078332 18602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:40:18.082911 18723 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:40:18.084648 18723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Bootstrap starting.
I20260810 01:40:18.088155 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 18602
I20260810 01:40:18.088673 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:41693
--local_ip_for_outbound_sockets=127.24.205.129
--tserver_master_addrs=127.24.205.190:41559
--webserver_port=41129
--webserver_interface=127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:40:18.104503 18723 log.cc:824] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:18.113901 18723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:40:18.114378 18723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Bootstrap complete.
I20260810 01:40:18.118633 18723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:18.119031 18723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20af04d5234da29f04a40058c17268, State: Initialized, Role: FOLLOWER
I20260810 01:40:18.119593 18723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:18.119719 18723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:40:18.119817 18723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:40:18.119936 18723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:40:18.121917 18723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:18.122274 18723 leader_election.cc:302] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f20af04d5234da29f04a40058c17268; no voters:
I20260810 01:40:18.122622 18723 leader_election.cc:288] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:40:18.122712 18730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:40:18.122900 18730 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 LEADER]: Becoming Leader. State: Replica: 5f20af04d5234da29f04a40058c17268, State: Running, Role: LEADER
I20260810 01:40:18.123284 18730 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:18.123951 18723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:40:18.125023 18733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f20af04d5234da29f04a40058c17268. Latest consensus state: current_term: 2 leader_uuid: "5f20af04d5234da29f04a40058c17268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } } }
I20260810 01:40:18.125069 18731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5f20af04d5234da29f04a40058c17268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } } }
I20260810 01:40:18.125165 18733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: This master's current role is: LEADER
I20260810 01:40:18.125197 18731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: This master's current role is: LEADER
I20260810 01:40:18.129177 18750 catalog_manager.cc:1259] Loaded cluster ID: 540891e7d31f4b1d8396343b5a8cebee
I20260810 01:40:18.129258 18750 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: loading cluster ID for follower catalog manager: success
I20260810 01:40:18.130995 18750 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: acquiring CA information for follower catalog manager: success
I20260810 01:40:18.132417 18750 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:40:18.132586 18741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:40:18.134595 18741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:40:18.135005 18741 catalog_manager.cc:1259] Loaded cluster ID: 540891e7d31f4b1d8396343b5a8cebee
I20260810 01:40:18.135079 18741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:40:18.135725 18741 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:40:18.136220 18741 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Loaded TSK: 0
I20260810 01:40:18.156576 18741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Generated new TSK 1
I20260810 01:40:18.156878 18741 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:40:18.219475 18728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:18.219722 18728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:18.219766 18728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:18.223785 18728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:18.223850 18728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:18.223906 18728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:40:18.229573 18728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:41693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=41129
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:18.230654 18728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:18.231650 18728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:18.241524 18763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:18.241524 18764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:18.241600 18766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:18.241952 18728 server_base.cc:1034] running on GCE node
I20260810 01:40:18.242383 18728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:18.243016 18728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:18.244204 18728 hybrid_clock.cc:648] HybridClock initialized: now 1786326018244171 us; error 61 us; skew 500 ppm
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:18.247227 18728 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:40:18.248237 18728 webserver.cc:460] Webserver started at http://127.24.205.129:41129/ using document root <none> and password file <none>
I20260810 01:40:18.248805 18728 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:18.248912 18728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:18.252795 18728 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260810 01:40:18.255082 18780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.256526 18728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:40:18.256657 18728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "c1beda4213c24f468c93ecf19f271ae0"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "f149c1f0c1c020fe45a48585ad646f26"
server_key_iv: "8bc6bdd041aae2f74207ac2e164284f7"
server_key_version: "encryptionkey@0"
I20260810 01:40:18.257211 18728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:18.273608 18728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:18.277015 18728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:18.277221 18728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:18.277876 18728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:18.278977 18793 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:40:18.283360 18728 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:40:18.283423 18728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260810 01:40:18.283492 18728 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:40:18.285171 18728 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:40:18.285229 18728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260810 01:40:18.285483 18793 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap starting.
I20260810 01:40:18.296684 18728 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:41693
I20260810 01:40:18.296862 18979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:41693 every 8 connection(s)
I20260810 01:40:18.297983 18728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:40:18.306375 18793 log.cc:824] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:18.307096 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 18728
I20260810 01:40:18.307550 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:36259
--local_ip_for_outbound_sockets=127.24.205.130
--tserver_master_addrs=127.24.205.190:41559
--webserver_port=39463
--webserver_interface=127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:40:18.314671 18793 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:40:18.315150 18793 tablet_bootstrap.cc:492] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap complete.
I20260810 01:40:18.316501 18793 ts_tablet_manager.cc:1397] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Time spent bootstrapping tablet: real 0.031s user 0.019s sys 0.011s
I20260810 01:40:18.317119 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.300153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:34325 (local address 127.24.205.190:41559)
0810 01:40:18.300545 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.300567 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.300898 (+ 331us) server_negotiation.cc:407] Connection header received
0810 01:40:18.302024 (+ 1126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.302036 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.302318 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.302721 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:18.303836 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.304899 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.306095 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.306637 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.306820 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.310888 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:18.310894 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:18.310910 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:18.310943 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:18.313116 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.313839 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.313845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.313851 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.314002 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.314462 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.314466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.314467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.314961 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:18.315111 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.315836 (+ 725us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.316185 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":135,"threads_started":1}
I20260810 01:40:18.317296 18985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.300154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:34325)
0810 01:40:18.300720 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.300768 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.301602 (+ 834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.302708 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.302717 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.303184 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:18.303643 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.303656 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.305084 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.305087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.305952 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.305962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.307798 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.307807 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.308002 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.308749 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:18.308769 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:18.310657 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:18.313261 (+ 2604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.313270 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.313285 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.313701 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.314120 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.314126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.314131 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.314337 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.315100 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:18.315110 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:18.315448 (+ 338us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.315701 (+ 253us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.316144 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":189,"threads_started":1}
I20260810 01:40:18.319555 18793 raft_consensus.cc:348] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.320120 18793 raft_consensus.cc:729] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1beda4213c24f468c93ecf19f271ae0, State: Initialized, Role: FOLLOWER
I20260810 01:40:18.320166 18981 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41559
I20260810 01:40:18.320401 18981 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:18.320645 18793 consensus_queue.cc:260] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.320935 18981 heartbeater.cc:511] Master 127.24.205.190:41559 requested a full tablet report, sending...
I20260810 01:40:18.321691 18793 ts_tablet_manager.cc:1428] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260810 01:40:18.323851 18663 ts_manager.cc:194] Registered new tserver with Master: c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129:41693)
I20260810 01:40:18.327925 18663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:34325
I20260810 01:40:18.330667 18981 heartbeater.cc:503] Master 127.24.205.190:41559 was elected leader, sending a full tablet report...
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.129@KRBTEST.COM
I20260810 01:40:18.338650 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.327253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:41693 (local address 127.0.0.1:50548)
0810 01:40:18.328012 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.328117 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.328248 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.328889 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.328894 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.329379 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:18.329515 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.329524 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.330991 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.330995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.331747 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.331757 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.332440 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.332444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.332564 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.333177 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:18.333189 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:18.334620 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:18.336765 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.336776 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.336782 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.337042 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.337368 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.337372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.337374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.337466 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.337955 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:18.337961 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:18.338102 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.338251 (+ 149us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.338464 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":103,"threads_started":1}
I20260810 01:40:18.338660 18999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.327320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50548 (local address 127.24.205.129:41693)
0810 01:40:18.328470 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.328480 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.328499 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:40:18.328572 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.328576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.328728 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.328887 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:18.329660 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.330856 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.331888 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.332311 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.332444 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.334768 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:18.334786 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:18.334799 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:18.334822 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:18.336644 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.337181 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.337186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.337188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.337268 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.337573 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.337577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.337578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.337831 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:18.337982 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.338340 (+ 358us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.338510 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1066,"thread_start_us":109,"threads_started":1}
I20260810 01:40:18.339854 18869 tablet_service.cc:1514] Processing DeleteTablet for tablet 37485094a18c4d57947d324af9905423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:39:57 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:50548
I20260810 01:40:18.340777 19000 tablet_replica.cc:330] stopping tablet replica
I20260810 01:40:18.341094 19000 raft_consensus.cc:2229] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:40:18.341356 19000 raft_consensus.cc:2258] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:18.342381 19000 ts_tablet_manager.cc:1905] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:40:18.346176 19000 ts_tablet_manager.cc:1918] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:40:18.346263 19000 log.cc:1196] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal/wals/37485094a18c4d57947d324af9905423
I20260810 01:40:18.346539 19000 ts_tablet_manager.cc:1939] T 37485094a18c4d57947d324af9905423 P c1beda4213c24f468c93ecf19f271ae0: Deleting consensus metadata
I20260810 01:40:18.348264 18637 catalog_manager.cc:4841] TS c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129:41693): tablet 37485094a18c4d57947d324af9905423 (table test-table [id=00ee7e795c674959986d97ef413a4149]) successfully deleted
W20260810 01:40:18.433207 18992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:18.433503 18992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:18.433578 18992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:18.437619 18992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:18.437708 18992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:18.437801 18992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:40:18.443121 18992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:36259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=39463
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:18.444376 18992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:18.445434 18992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:18.455443 19011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:18.455470 19012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:18.455483 19014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:18.455716 18992 server_base.cc:1034] running on GCE node
I20260810 01:40:18.456230 18992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:18.456822 18992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:18.458034 18992 hybrid_clock.cc:648] HybridClock initialized: now 1786326018458007 us; error 36 us; skew 500 ppm
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:18.460994 18992 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:40:18.461987 18992 webserver.cc:460] Webserver started at http://127.24.205.130:39463/ using document root <none> and password file <none>
I20260810 01:40:18.462561 18992 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:18.462666 18992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:18.466835 18992 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260810 01:40:18.469002 19026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.470438 18992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:40:18.470561 18992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "0322282ead2f4fc398ca6561bd2eb635"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "861e221660190c49d2cc7621a1abc9fb"
server_key_iv: "87b43fe6f623187d03444221e596e90b"
server_key_version: "encryptionkey@0"
I20260810 01:40:18.471105 18992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:18.489197 18992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:18.492326 18992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:18.492527 18992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:18.493160 18992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:18.494002 18992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:18.494051 18992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.494117 18992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:18.494151 18992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.503749 18992 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36259
I20260810 01:40:18.503823 19224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36259 every 8 connection(s)
I20260810 01:40:18.504958 18992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:40:18.506650 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 18992
I20260810 01:40:18.507160 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:40613
--local_ip_for_outbound_sockets=127.24.205.131
--tserver_master_addrs=127.24.205.190:41559
--webserver_port=36825
--webserver_interface=127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:40:18.522145 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.506852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:38279 (local address 127.24.205.190:41559)
0810 01:40:18.507050 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.507057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.508016 (+ 959us) server_negotiation.cc:407] Connection header received
0810 01:40:18.509992 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.509997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.510069 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.510172 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:18.511387 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.512321 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.513665 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.514118 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.514256 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.517734 (+ 3478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:18.517740 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:18.517745 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:18.517783 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:18.519690 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.520370 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.520377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.520382 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.520511 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.520880 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.520887 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.520891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.521177 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:18.521301 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.521816 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.521966 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 01:40:18.522969 19229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.507225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:38279)
0810 01:40:18.507816 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.507879 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.509749 (+ 1870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.510345 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.510352 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.510729 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:18.511223 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.511236 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.512481 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.512484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.513501 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.513512 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.514283 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.514286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.514435 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.515197 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:18.515238 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:18.517528 (+ 2290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:18.519868 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.519873 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.519885 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.520262 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.520618 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.520620 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.520621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.520763 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.521302 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:18.521307 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:18.521562 (+ 255us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.521719 (+ 157us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.521987 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":128,"threads_started":1}
I20260810 01:40:18.524317 19225 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41559
I20260810 01:40:18.524567 19225 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:18.525136 19225 heartbeater.cc:511] Master 127.24.205.190:41559 requested a full tablet report, sending...
I20260810 01:40:18.526261 18663 ts_manager.cc:194] Registered new tserver with Master: 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
I20260810 01:40:18.526827 18663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:38279
W20260810 01:40:18.628930 19234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:18.629212 19234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:18.629297 19234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:18.633278 19234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:18.633353 19234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:18.633433 19234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:40:18.638547 19234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:40613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=36825
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:18.639560 19234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:18.640687 19234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:18.650228 19250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:18.650290 19241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:18.650416 19243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:18.650480 19234 server_base.cc:1034] running on GCE node
I20260810 01:40:18.650899 19234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:18.651538 19234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:18.652715 19234 hybrid_clock.cc:648] HybridClock initialized: now 1786326018652702 us; error 30 us; skew 500 ppm
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:18.655462 19234 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:40:18.656515 19234 webserver.cc:460] Webserver started at http://127.24.205.131:36825/ using document root <none> and password file <none>
I20260810 01:40:18.657051 19234 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:18.657127 19234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:18.660989 19234 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 01:40:18.663136 19262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.664433 19234 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:40:18.664530 19234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "962a707e213643c6b945d90314f27810"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "77a0c91172ee72ed4f7c87e6c9925994"
server_key_iv: "bb12af1e26570d26fc32f79b24bf3d1a"
server_key_version: "encryptionkey@0"
I20260810 01:40:18.665046 19234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:18.682981 19234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:18.685987 19234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:18.686206 19234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:18.686811 19234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:18.687647 19234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:18.687698 19234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.687769 19234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:18.687808 19234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:18.697477 19234 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:40613
I20260810 01:40:18.697511 19455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:40613 every 8 connection(s)
I20260810 01:40:18.698480 19234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:40:18.706120 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 19234
Aug 10 01:40:18 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326018, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:40:18.712718 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.700315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:59979 (local address 127.24.205.190:41559)
0810 01:40:18.700452 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.700455 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.701647 (+ 1192us) server_negotiation.cc:407] Connection header received
0810 01:40:18.702561 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.702564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.702622 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.702731 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:18.704042 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.704612 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.705778 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.706010 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.706124 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.709119 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:18.709123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:18.709130 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:18.709155 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:18.710570 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.711101 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.711105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.711107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.711197 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.711547 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.711552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.711553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.711733 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:18.711843 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.712417 (+ 574us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.712544 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:40:18.713650 19460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.700609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:59979)
0810 01:40:18.701491 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.701535 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.702351 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.702947 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.702955 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.703310 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:18.703890 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.703904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.704746 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.704749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.705628 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.705637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.706167 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.706171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.706384 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.707126 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:18.707147 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:18.708948 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:18.710706 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.710712 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.710726 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.710990 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.711293 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:18.711297 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:18.711299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:18.711446 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:18.711842 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:18.711849 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:18.712157 (+ 308us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.712359 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.712697 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":544,"threads_started":1}
I20260810 01:40:18.714890 19458 heartbeater.cc:347] Connected to a master server at 127.24.205.190:41559
I20260810 01:40:18.715137 19458 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:18.715291 19461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.706855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36570 (local address 127.24.205.190:41559)
0810 01:40:18.707120 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.707126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.707334 (+ 208us) server_negotiation.cc:407] Connection header received
0810 01:40:18.707466 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.707468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.707517 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.707594 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:18.708534 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.709121 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.710292 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.710535 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.710646 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.711981 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:18.711985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:18.711987 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:18.712020 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:18.713610 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.714077 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.714082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.714084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.714167 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.714451 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.714455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.714457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.714629 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:18.714847 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.714991 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.715121 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":71,"threads_started":1}
I20260810 01:40:18.715770 19458 heartbeater.cc:511] Master 127.24.205.190:41559 requested a full tablet report, sending...
I20260810 01:40:18.716988 18659 ts_manager.cc:194] Registered new tserver with Master: 962a707e213643c6b945d90314f27810 (127.24.205.131:40613)
I20260810 01:40:18.717780 18659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:59979
I20260810 01:40:18.729540 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:40:18.736891 19461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.730382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36572 (local address 127.24.205.190:41559)
0810 01:40:18.730536 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.730541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.732684 (+ 2143us) server_negotiation.cc:407] Connection header received
0810 01:40:18.732893 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.732896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.733070 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.733190 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:40:18.733839 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.734584 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.735746 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.735972 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.736112 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.736401 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:40:18.736546 (+ 145us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 01:40:18.736785 (+ 239us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36572: token expired
Metrics: {"server-negotiator.queue_time_us":66}
W20260810 01:40:18.736951 19461 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36572: token expired
W20260810 01:40:18.737334 18539 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.24.205.190:41559)
I20260810 01:40:18.744889 19461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.737718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36584 (local address 127.24.205.190:41559)
0810 01:40:18.737833 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.737840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.737891 (+ 51us) server_negotiation.cc:407] Connection header received
0810 01:40:18.738018 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.738021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.738067 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.738153 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:18.738777 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.739252 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.740045 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.740292 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.740400 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.741789 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:18.741792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:18.741794 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:18.741817 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:18.743133 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.743567 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.743571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.743573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.743657 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:18.743953 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:18.743956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:18.743958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:18.744218 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:18.744362 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.744599 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.744715 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:40:18.747385 18659 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36584:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:40:18.750849 18659 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:40:18.759403 18869 tablet_service.cc:1467] Processing CreateTablet for tablet dd4693aea93e48efb5f144e7104c9834 (DEFAULT_TABLE table=test-table [id=d96a2f3cf4e048bd85340b9b10c5de91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:18.760149 18869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd4693aea93e48efb5f144e7104c9834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:18.763566 19472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.758651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44866 (local address 127.24.205.130:36259)
0810 01:40:18.759077 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.759102 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.759123 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:40:18.759195 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.759201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.759439 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.759619 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:18.760168 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.761190 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.762361 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.762934 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.763082 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.763225 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.763326 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.763417 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":126,"threads_started":1}
I20260810 01:40:18.763581 18793 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap starting.
I20260810 01:40:18.763720 19471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.758457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36259 (local address 127.0.0.1:44866)
0810 01:40:18.758728 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.758739 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.758844 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.759862 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.759866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.759888 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:18.759983 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.759993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.761291 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.761298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.762229 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.762239 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.763081 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.763084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.763170 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.763214 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.763297 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.763375 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":11,"thread_start_us":116,"threads_started":1}
I20260810 01:40:18.764040 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.757996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40613 (local address 127.0.0.1:53884)
0810 01:40:18.758131 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.758148 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.758232 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.759630 (+ 1398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.759633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.759654 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:18.759766 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.759776 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.761350 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.761353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.762517 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.762529 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.763675 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.763678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.763773 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.763795 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.763845 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.763916 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":1}
I20260810 01:40:18.764561 18793 tablet_bootstrap.cc:654] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:18.764694 19470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.758181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53884 (local address 127.24.205.131:40613)
0810 01:40:18.759033 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.759047 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.759105 (+ 58us) server_negotiation.cc:407] Connection header received
0810 01:40:18.759196 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.759201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.759438 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.759619 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:18.759945 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.761212 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.762695 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.763519 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.764247 (+ 728us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.764370 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.764425 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.764538 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":165,"threads_started":1}
I20260810 01:40:18.767079 19114 tablet_service.cc:1467] Processing CreateTablet for tablet dd4693aea93e48efb5f144e7104c9834 (DEFAULT_TABLE table=test-table [id=d96a2f3cf4e048bd85340b9b10c5de91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:18.768293 19114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd4693aea93e48efb5f144e7104c9834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:18.767935 19351 tablet_service.cc:1467] Processing CreateTablet for tablet dd4693aea93e48efb5f144e7104c9834 (DEFAULT_TABLE table=test-table [id=d96a2f3cf4e048bd85340b9b10c5de91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:18.768803 18793 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: No bootstrap required, opened a new log
I20260810 01:40:18.768922 18793 ts_tablet_manager.cc:1397] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 01:40:18.769011 19351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd4693aea93e48efb5f144e7104c9834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:18.769472 18793 raft_consensus.cc:348] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.769621 18793 raft_consensus.cc:374] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:18.769671 18793 raft_consensus.cc:729] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1beda4213c24f468c93ecf19f271ae0, State: Initialized, Role: FOLLOWER
I20260810 01:40:18.769805 18793 consensus_queue.cc:260] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.772048 18793 ts_tablet_manager.cc:1428] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:40:18.777078 19475 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Bootstrap starting.
I20260810 01:40:18.778108 19477 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Bootstrap starting.
I20260810 01:40:18.779632 19475 tablet_bootstrap.cc:654] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:18.780364 19477 tablet_bootstrap.cc:654] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:18.780658 19475 log.cc:824] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:18.781188 19477 log.cc:824] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:18.782593 19475 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: No bootstrap required, opened a new log
I20260810 01:40:18.782812 19475 ts_tablet_manager.cc:1397] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:40:18.783033 19477 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: No bootstrap required, opened a new log
I20260810 01:40:18.783229 19477 ts_tablet_manager.cc:1397] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 01:40:18.785995 19475 raft_consensus.cc:348] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.786337 19475 raft_consensus.cc:374] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:18.786396 19475 raft_consensus.cc:729] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0322282ead2f4fc398ca6561bd2eb635, State: Initialized, Role: FOLLOWER
I20260810 01:40:18.786361 19477 raft_consensus.cc:348] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.786670 19477 raft_consensus.cc:374] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:18.786731 19477 raft_consensus.cc:729] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 962a707e213643c6b945d90314f27810, State: Initialized, Role: FOLLOWER
I20260810 01:40:18.786898 19475 consensus_queue.cc:260] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.787142 19477 consensus_queue.cc:260] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.787608 19225 heartbeater.cc:503] Master 127.24.205.190:41559 was elected leader, sending a full tablet report...
I20260810 01:40:18.787784 19458 heartbeater.cc:503] Master 127.24.205.190:41559 was elected leader, sending a full tablet report...
I20260810 01:40:18.788048 19475 ts_tablet_manager.cc:1428] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:40:18.789173 19477 ts_tablet_manager.cc:1428] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
W20260810 01:40:18.799192 18982 tablet.cc:2369] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:40:18.824872 18995 raft_consensus.cc:482] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:18.825188 18995 raft_consensus.cc:504] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.826375 18995 leader_election.cc:288] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
I20260810 01:40:18.830514 19470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.826729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:45417 (local address 127.24.205.131:40613)
0810 01:40:18.826927 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.826933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.827153 (+ 220us) server_negotiation.cc:407] Connection header received
0810 01:40:18.827272 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.827274 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.827314 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.827406 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:18.827739 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.828285 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.829459 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.829843 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.830076 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.830130 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.830305 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.830386 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260810 01:40:18.830514 19472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.826744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:52821 (local address 127.24.205.130:36259)
0810 01:40:18.826908 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.826914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.827031 (+ 117us) server_negotiation.cc:407] Connection header received
0810 01:40:18.827223 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.827228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.827294 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.827355 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:18.827688 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.828274 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.829398 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.829818 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.829915 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.829957 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.830337 (+ 380us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.830403 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:40:18.830538 19485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.826615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40613 (local address 127.24.205.129:45417)
0810 01:40:18.827035 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.827055 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.827176 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.827438 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.827441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.827462 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:18.827595 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.827600 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.828418 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.828421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.829294 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.829304 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.830107 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.830110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.830181 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.830200 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.830262 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.830371 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":69,"thread_start_us":90,"threads_started":1}
I20260810 01:40:18.830550 19483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.826607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36259 (local address 127.24.205.129:52821)
0810 01:40:18.826921 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.826937 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:18.827062 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:18.827398 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:18.827401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:18.827417 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:18.827573 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.827579 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.828390 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.828396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.829269 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:18.829278 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.830046 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.830050 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:18.830143 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.830197 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 01:40:18.830303 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 01:40:18.830405 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":48,"thread_start_us":95,"threads_started":1}
I20260810 01:40:18.831149 19382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd4693aea93e48efb5f144e7104c9834" candidate_uuid: "c1beda4213c24f468c93ecf19f271ae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "962a707e213643c6b945d90314f27810" is_pre_election: true
I20260810 01:40:18.831457 19382 raft_consensus.cc:2454] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1beda4213c24f468c93ecf19f271ae0 in term 0.
I20260810 01:40:18.831949 18785 leader_election.cc:302] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 962a707e213643c6b945d90314f27810, c1beda4213c24f468c93ecf19f271ae0; no voters:
I20260810 01:40:18.832289 18995 raft_consensus.cc:2781] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:40:18.832301 19147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd4693aea93e48efb5f144e7104c9834" candidate_uuid: "c1beda4213c24f468c93ecf19f271ae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0322282ead2f4fc398ca6561bd2eb635" is_pre_election: true
I20260810 01:40:18.832398 18995 raft_consensus.cc:482] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:40:18.832449 18995 raft_consensus.cc:3037] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:18.832581 19147 raft_consensus.cc:2454] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1beda4213c24f468c93ecf19f271ae0 in term 0.
I20260810 01:40:18.833709 18995 raft_consensus.cc:504] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.834030 18995 leader_election.cc:288] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 1 election: Requested vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
I20260810 01:40:18.834331 19147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd4693aea93e48efb5f144e7104c9834" candidate_uuid: "c1beda4213c24f468c93ecf19f271ae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0322282ead2f4fc398ca6561bd2eb635"
I20260810 01:40:18.834331 19382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd4693aea93e48efb5f144e7104c9834" candidate_uuid: "c1beda4213c24f468c93ecf19f271ae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "962a707e213643c6b945d90314f27810"
I20260810 01:40:18.834447 19382 raft_consensus.cc:3037] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:18.834447 19147 raft_consensus.cc:3037] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:18.835772 19382 raft_consensus.cc:2454] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1beda4213c24f468c93ecf19f271ae0 in term 1.
I20260810 01:40:18.835772 19147 raft_consensus.cc:2454] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1beda4213c24f468c93ecf19f271ae0 in term 1.
I20260810 01:40:18.836117 18784 leader_election.cc:302] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810, c1beda4213c24f468c93ecf19f271ae0; no voters:
I20260810 01:40:18.836274 18995 raft_consensus.cc:2781] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:40:18.836488 18995 raft_consensus.cc:686] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 LEADER]: Becoming Leader. State: Replica: c1beda4213c24f468c93ecf19f271ae0, State: Running, Role: LEADER
I20260810 01:40:18.836755 18995 consensus_queue.cc:237] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:18.839892 18663 catalog_manager.cc:5495] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129). New cstate: current_term: 1 leader_uuid: "c1beda4213c24f468c93ecf19f271ae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } health_report { overall_health: HEALTHY } } }
I20260810 01:40:18.868572 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.864721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50564 (local address 127.24.205.129:41693)
0810 01:40:18.865038 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:18.865041 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:18.865054 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:40:18.865127 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:18.865129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:18.865184 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:18.865316 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:40:18.865580 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.866114 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.867007 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:18.867251 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:18.867372 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:18.867670 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:40:18.868153 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:40:18.868292 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:18.868355 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 01:40:18.868411 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":79,"threads_started":1}
I20260810 01:40:18.872531 19147 raft_consensus.cc:1261] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 FOLLOWER]: Refusing update from remote peer c1beda4213c24f468c93ecf19f271ae0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:40:18.872531 19382 raft_consensus.cc:1261] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Refusing update from remote peer c1beda4213c24f468c93ecf19f271ae0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:40:18.873317 18995 consensus_queue.cc:1035] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:40:18.873507 19486 consensus_queue.cc:1035] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:40:18.880949 19490 mvcc.cc:205] Tried to move back new op lower bound from 7316791373295321088 to 7316791373157724160. Current Snapshot: MvccSnapshot[applied={T|T < 7316791373295321088}]
I20260810 01:40:18.889891 18663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:40:18.890076 18663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:40:18.892728 18663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Sending DeleteTablet for 3 replicas of tablet dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:18.893446 19351 tablet_service.cc:1514] Processing DeleteTablet for tablet dd4693aea93e48efb5f144e7104c9834 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:18 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:53884
I20260810 01:40:18.893549 19114 tablet_service.cc:1514] Processing DeleteTablet for tablet dd4693aea93e48efb5f144e7104c9834 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:18 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:44866
I20260810 01:40:18.893754 18869 tablet_service.cc:1514] Processing DeleteTablet for tablet dd4693aea93e48efb5f144e7104c9834 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:18 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:50548
I20260810 01:40:18.894075 19508 tablet_replica.cc:330] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: stopping tablet replica
I20260810 01:40:18.894137 19506 tablet_replica.cc:330] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: stopping tablet replica
I20260810 01:40:18.894210 19508 raft_consensus.cc:2229] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:40:18.894454 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 18728
I20260810 01:40:18.894454 19506 raft_consensus.cc:2229] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:40:18.894486 19508 raft_consensus.cc:2258] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:18.904548 19506 raft_consensus.cc:2258] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:18.906713 19506 ts_tablet_manager.cc:1905] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:40:18.906880 19507 tablet_replica.cc:330] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: stopping tablet replica
I20260810 01:40:18.907233 19507 raft_consensus.cc:2229] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:40:18.907564 19507 raft_consensus.cc:2258] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:18.910531 19506 ts_tablet_manager.cc:1918] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:40:18.910667 19506 log.cc:1196] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:18.910809 19507 ts_tablet_manager.cc:1905] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:40:18.911080 19506 ts_tablet_manager.cc:1939] T dd4693aea93e48efb5f144e7104c9834 P 962a707e213643c6b945d90314f27810: Deleting consensus metadata
I20260810 01:40:18.912348 18638 catalog_manager.cc:4841] TS 962a707e213643c6b945d90314f27810 (127.24.205.131:40613): tablet dd4693aea93e48efb5f144e7104c9834 (table test-table [id=d96a2f3cf4e048bd85340b9b10c5de91]) successfully deleted
I20260810 01:40:18.914279 19507 ts_tablet_manager.cc:1918] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:40:18.914394 19507 log.cc:1196] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:18.914804 19507 ts_tablet_manager.cc:1939] T dd4693aea93e48efb5f144e7104c9834 P 0322282ead2f4fc398ca6561bd2eb635: Deleting consensus metadata
I20260810 01:40:18.916271 18637 catalog_manager.cc:4841] TS 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259): tablet dd4693aea93e48efb5f144e7104c9834 (table test-table [id=d96a2f3cf4e048bd85340b9b10c5de91]) successfully deleted
W20260810 01:40:18.917523 18637 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:41693 (error 108)
I20260810 01:40:18.918008 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 18992
I20260810 01:40:18.918776 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:18.918380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:41693 (local address 127.0.0.1:50578)
0810 01:40:18.918592 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:18.918671 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:41693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
W20260810 01:40:18.918957 18637 catalog_manager.cc:4584] TS c1beda4213c24f468c93ecf19f271ae0 (127.24.205.129:41693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd4693aea93e48efb5f144e7104c9834: Network error: Client connection negotiation failed: client connection to 127.24.205.129:41693: connect: Connection refused (error 111)
I20260810 01:40:18.934020 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 19234
I20260810 01:40:18.952353 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 18602
I20260810 01:40:38.964463 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41559
--webserver_interface=127.24.205.190
--webserver_port=40529
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:41559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:40:39.086457 19515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:39.086752 19515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:39.086796 19515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:39.090927 19515 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 01:40:39.090996 19515 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 01:40:39.091012 19515 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 01:40:39.091027 19515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:40:39.091076 19515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:39.091112 19515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:39.091192 19515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:40:39.091236 19515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:40:39.096737 19515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:41559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:41559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=40529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:39.097934 19515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:39.099000 19515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:39.107708 19527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.107713 19530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.107713 19528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:39.108464 19515 server_base.cc:1034] running on GCE node
I20260810 01:40:39.109078 19515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:39.110205 19515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:39.111423 19515 hybrid_clock.cc:648] HybridClock initialized: now 1786326039111398 us; error 41 us; skew 500 ppm
Aug 10 01:40:39 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326039, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:39.114522 19515 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:40:39.115679 19515 webserver.cc:460] Webserver started at http://127.24.205.190:40529/ using document root <none> and password file <none>
I20260810 01:40:39.116423 19515 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:39.116515 19515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:39.121764 19515 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:40:39.124583 19544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.126235 19515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:40:39.126374 19515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "5f20af04d5234da29f04a40058c17268"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "4563bb5656465771f0cf09824b60084d"
server_key_iv: "01b0fe747dd082aa845af70497571528"
server_key_version: "encryptionkey@0"
I20260810 01:40:39.127138 19515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:39.170585 19515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:39.174213 19515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:39.174433 19515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:39.181859 19515 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:41559
I20260810 01:40:39.182156 19622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:41559 every 8 connection(s)
I20260810 01:40:39.183033 19515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:40:39.187534 19625 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:40:39.189323 19625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Bootstrap starting.
I20260810 01:40:39.193038 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 19515
I20260810 01:40:39.193570 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:41693
--local_ip_for_outbound_sockets=127.24.205.129
--tserver_master_addrs=127.24.205.190:41559
--webserver_port=41129
--webserver_interface=127.24.205.129
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:40:39.208841 19625 log.cc:824] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:39.220245 19625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:40:39.220643 19625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Bootstrap complete.
I20260810 01:40:39.224795 19625 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:39.225206 19625 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20af04d5234da29f04a40058c17268, State: Initialized, Role: FOLLOWER
I20260810 01:40:39.225754 19625 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:39.225903 19625 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:40:39.225994 19625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:40:39.226114 19625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 2 FOLLOWER]: Advancing to term 3
I20260810 01:40:39.228003 19625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:39.228379 19625 leader_election.cc:302] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f20af04d5234da29f04a40058c17268; no voters:
I20260810 01:40:39.228761 19625 leader_election.cc:288] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 01:40:39.228894 19631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 01:40:39.229225 19631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [term 3 LEADER]: Becoming Leader. State: Replica: 5f20af04d5234da29f04a40058c17268, State: Running, Role: LEADER
I20260810 01:40:39.229621 19631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } }
I20260810 01:40:39.230093 19625 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:40:39.231308 19634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f20af04d5234da29f04a40058c17268. Latest consensus state: current_term: 3 leader_uuid: "5f20af04d5234da29f04a40058c17268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } } }
I20260810 01:40:39.231439 19634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: This master's current role is: LEADER
I20260810 01:40:39.231791 19632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "5f20af04d5234da29f04a40058c17268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f20af04d5234da29f04a40058c17268" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 41559 } } }
I20260810 01:40:39.231904 19632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268 [sys.catalog]: This master's current role is: LEADER
I20260810 01:40:39.232779 19646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:40:39.238011 19646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:40:39.238694 19646 catalog_manager.cc:1259] Loaded cluster ID: 540891e7d31f4b1d8396343b5a8cebee
I20260810 01:40:39.238761 19646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:40:39.241484 19646 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:40:39.242251 19646 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Loaded TSK: 0
I20260810 01:40:39.242340 19646 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5f20af04d5234da29f04a40058c17268: Loaded TSK: 1
F20260810 01:40:39.243742 19646 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f21f54fc9ad google::LogMessage::Fail() at ??:0
@ 0x7f21f54ff88a google::LogMessage::SendToLog() at ??:0
@ 0x7f21f54fc4de google::LogMessage::Flush() at ??:0
@ 0x7f21f54fda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f21f81c018d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f21f81b8f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f21ffe657bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f21ffe3f99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f21ffe40178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f21ffe81df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f21ffea082b std::function<>::operator()() at ??:0
@ 0x7f21ffe3fb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f21ffe40f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f21ffe3d579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f21ffe81640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f21f774e3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f21f774ec83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f21f77503f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f21f773f512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f21f8d836db start_thread at ??:0
@ 0x7f21f3ffa61f clone at ??:0
W20260810 01:40:39.338975 19627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:39.339212 19627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:39.339255 19627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:39.343479 19627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:39.343576 19627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:39.343698 19627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:40:39.349012 19627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:41693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=41129
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:39.350077 19627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:39.351171 19627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:39.360774 19703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.360764 19696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.360776 19698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:39.361364 19627 server_base.cc:1034] running on GCE node
I20260810 01:40:39.361770 19627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:39.362453 19627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:39.363682 19627 hybrid_clock.cc:648] HybridClock initialized: now 1786326039363665 us; error 31 us; skew 500 ppm
Aug 10 01:40:39 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326039, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:39.366555 19627 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:40:39.367472 19627 webserver.cc:460] Webserver started at http://127.24.205.129:41129/ using document root <none> and password file <none>
I20260810 01:40:39.368037 19627 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:39.368170 19627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:39.373070 19627 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:40:39.375439 19713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.376880 19627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:40:39.377022 19627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "c1beda4213c24f468c93ecf19f271ae0"
format_stamp: "Formatted at 2026-08-10 01:39:56 on dist-test-slave-t3q3"
server_key: "f149c1f0c1c020fe45a48585ad646f26"
server_key_iv: "8bc6bdd041aae2f74207ac2e164284f7"
server_key_version: "encryptionkey@0"
I20260810 01:40:39.377589 19627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:39.396116 19627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:39.399892 19627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:39.400164 19627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:39.400952 19627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:39.402371 19728 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:40:39.406806 19627 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:40:39.406886 19627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260810 01:40:39.406956 19627 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:40:39.409281 19627 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:40:39.409354 19627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260810 01:40:39.409686 19728 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap starting.
I20260810 01:40:39.420699 19627 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:41693
I20260810 01:40:39.420759 19900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:41693 every 8 connection(s)
I20260810 01:40:39.421914 19627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:40:39.429729 19728 log.cc:824] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:39.432204 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 19627
I20260810 01:40:39.432736 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:36259
--local_ip_for_outbound_sockets=127.24.205.130
--tserver_master_addrs=127.24.205.190:41559
--webserver_port=39463
--webserver_interface=127.24.205.130
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:40:39.437616 19728 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:40:39.438004 19728 tablet_bootstrap.cc:492] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Bootstrap complete.
I20260810 01:40:39.439107 19728 ts_tablet_manager.cc:1397] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Time spent bootstrapping tablet: real 0.030s user 0.028s sys 0.000s
I20260810 01:40:39.441686 19728 raft_consensus.cc:348] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:39.442128 19728 raft_consensus.cc:729] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1beda4213c24f468c93ecf19f271ae0, State: Initialized, Role: FOLLOWER
I20260810 01:40:39.442656 19728 consensus_queue.cc:260] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:39.443657 19728 ts_tablet_manager.cc:1428] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260810 01:40:39.500720 19904 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:40:39.424295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:36569)
0810 01:40:39.424936 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.425019 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:39.426125 (+ 1106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:39.499782 (+ 73657us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":157,"threads_started":1}
W20260810 01:40:39.501240 19902 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:41559 (0 consecutive failures): Network error: Failed to ping master at 127.24.205.190:41559: Client connection negotiation failed: client connection to 127.24.205.190:41559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:40:39.502022 19904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.501735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:42185)
0810 01:40:39.501863 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.501949 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 01:40:39.502651 19904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.502443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:39191)
0810 01:40:39.502551 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.502598 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 01:40:39.502815 19902 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:40:39.567345 19908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:39.567678 19908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:39.567770 19908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:39.571887 19908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:39.571977 19908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:39.572126 19908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:40:39.577338 19908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:36259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=39463
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:39.578451 19908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:39.579535 19908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:39.589587 19920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.589602 19923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.589597 19921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:39.589815 19908 server_base.cc:1034] running on GCE node
I20260810 01:40:39.590320 19908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:39.590920 19908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:39.592144 19908 hybrid_clock.cc:648] HybridClock initialized: now 1786326039592118 us; error 28 us; skew 500 ppm
Aug 10 01:40:39 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326039, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:39.595738 19908 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:40:39.596948 19908 webserver.cc:460] Webserver started at http://127.24.205.130:39463/ using document root <none> and password file <none>
I20260810 01:40:39.597543 19908 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:39.597637 19908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:39.601697 19908 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:40:39.603906 19934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.605248 19908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:40:39.605393 19908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "0322282ead2f4fc398ca6561bd2eb635"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "861e221660190c49d2cc7621a1abc9fb"
server_key_iv: "87b43fe6f623187d03444221e596e90b"
server_key_version: "encryptionkey@0"
I20260810 01:40:39.605963 19908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:39.620512 19908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:39.623997 19908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:39.624254 19908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:39.624903 19908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:39.625770 19908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:39.625841 19908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.625913 19908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:39.625957 19908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.635473 19908 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:36259
I20260810 01:40:39.635535 20115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:36259 every 8 connection(s)
I20260810 01:40:39.636664 19908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:40:39.640749 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.638967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:43969)
0810 01:40:39.639467 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.639963 (+ 496us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":114,"threads_started":1}
W20260810 01:40:39.641289 20116 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:41559 (0 consecutive failures): Network error: Failed to ping master at 127.24.205.190:41559: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
I20260810 01:40:39.641918 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.641709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:58311)
0810 01:40:39.641814 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.641862 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 01:40:39.642544 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.642360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:37405)
0810 01:40:39.642455 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.642496 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 01:40:39.642807 20116 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:40:39.644481 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 19908
I20260810 01:40:39.644929 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:40613
--local_ip_for_outbound_sockets=127.24.205.131
--tserver_master_addrs=127.24.205.190:41559
--webserver_port=36825
--webserver_interface=127.24.205.131
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:45347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:40:39.761018 20121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:39.761262 20121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:39.761302 20121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:39.765245 20121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:39.765296 20121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:39.765364 20121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:40:39.770296 20121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:45347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:40613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=36825
--tserver_master_addrs=127.24.205.190:41559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:39.771219 20121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:39.772280 20121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:39.782042 20129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.782042 20128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:39.782065 20133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:39.782426 20121 server_base.cc:1034] running on GCE node
I20260810 01:40:39.782858 20121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:39.783484 20121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:39.784672 20121 hybrid_clock.cc:648] HybridClock initialized: now 1786326039784658 us; error 35 us; skew 500 ppm
Aug 10 01:40:39 dist-test-slave-t3q3 krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326039, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:39.787535 20121 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:40:39.788462 20121 webserver.cc:460] Webserver started at http://127.24.205.131:36825/ using document root <none> and password file <none>
I20260810 01:40:39.789000 20121 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:39.789059 20121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:39.792819 20121 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:40:39.794812 20145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.796051 20121 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:40:39.796239 20121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "962a707e213643c6b945d90314f27810"
format_stamp: "Formatted at 2026-08-10 01:39:57 on dist-test-slave-t3q3"
server_key: "77a0c91172ee72ed4f7c87e6c9925994"
server_key_iv: "bb12af1e26570d26fc32f79b24bf3d1a"
server_key_version: "encryptionkey@0"
I20260810 01:40:39.796785 20121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:39.809116 20121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:39.812105 20121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:39.812323 20121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:39.812938 20121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:39.813791 20121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:39.813839 20121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.813903 20121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:39.813938 20121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:39.822718 20121 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:40613
I20260810 01:40:39.822777 20320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:40613 every 8 connection(s)
I20260810 01:40:39.823850 20121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:40:39.827857 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.826160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:56601)
0810 01:40:39.826665 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.827121 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":112,"threads_started":1}
W20260810 01:40:39.828361 20321 heartbeater.cc:644] Failed to heartbeat to 127.24.205.190:41559 (0 consecutive failures): Network error: Failed to ping master at 127.24.205.190:41559: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
I20260810 01:40:39.829018 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.828782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:39051)
0810 01:40:39.828900 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.828964 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 01:40:39.829623 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:39.829408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:48569)
0810 01:40:39.829512 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:39.829559 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 01:40:39.829794 20321 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:40:39.833176 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 20121
I20260810 01:40:40.503918 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:40.503471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:35883)
0810 01:40:40.503743 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:40.503803 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":74,"threads_started":1}
I20260810 01:40:40.643743 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:40.643349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:42885)
0810 01:40:40.643581 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:40.643633 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":73,"threads_started":1}
I20260810 01:40:40.830796 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:40.830363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:41317)
0810 01:40:40.830625 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:40.830682 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":92,"threads_started":1}
I20260810 01:40:40.864820 20329 raft_consensus.cc:482] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:40.865020 20329 raft_consensus.cc:504] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:40.866103 20329 leader_election.cc:288] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
Aug 10 01:40:40 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326039, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.131@KRBTEST.COM
Aug 10 01:40:40 dist-test-slave-t3q3 krb5kdc[17687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326039, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.130@KRBTEST.COM
I20260810 01:40:40.880497 20331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:40.866536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:47545 (local address 127.24.205.130:36259)
0810 01:40:40.866840 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:40.866864 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:40.866902 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:40:40.867661 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:40.867668 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:40.868013 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:40.868383 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:40.869736 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.870844 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.872214 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.872695 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.872867 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:40.876003 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:40.876008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:40.876020 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:40.876137 (+ 117us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:40.877765 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:40.878376 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:40.878384 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:40.878390 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:40.878519 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:40.878905 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:40.878909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:40.878912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:40.879325 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:40.879473 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:40.880032 (+ 559us) server_negotiation.cc:299] Negotiation successful
0810 01:40:40.880326 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":75,"threads_started":1}
I20260810 01:40:40.880486 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:40.866341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40613 (local address 127.24.205.129:45259)
0810 01:40:40.866461 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:40.866478 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:40.866584 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:40.868442 (+ 1858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:40.868448 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:40.869021 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:40.869540 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:40.869555 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.871055 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.871059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:40.872025 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:40.872037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.872849 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.872853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:40.873069 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:40.873753 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:40.873770 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:40.875387 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:40.877851 (+ 2464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:40.877860 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:40.877878 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:40.878267 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:40.878662 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:40.878665 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:40.878666 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:40.878813 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:40.879450 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:40.879457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:40.879709 (+ 252us) client_negotiation.cc:769] Sending connection context
0810 01:40:40.879902 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 01:40:40.880284 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":128,"spinlock_wait_cycles":26880}
I20260810 01:40:40.880535 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:40.866354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:36259 (local address 127.24.205.129:47545)
0810 01:40:40.866788 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:40.866804 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:40.866911 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:40.868442 (+ 1531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:40.868448 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:40.869014 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:40.869543 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:40.869556 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.871006 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.871012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:40.872031 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:40.872041 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.872825 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.872829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:40.873073 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:40.873814 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:40.873826 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:40.875768 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:40.877918 (+ 2150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:40.877921 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:40.877922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:40.878256 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:40.878633 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:40.878639 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:40.878644 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:40.878805 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:40.879450 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:40.879457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:40.879719 (+ 262us) client_negotiation.cc:769] Sending connection context
0810 01:40:40.879902 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 01:40:40.880372 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":469,"spinlock_wait_cycles":66688,"thread_start_us":75,"threads_started":1}
I20260810 01:40:40.880548 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:40.866525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:45259 (local address 127.24.205.131:40613)
0810 01:40:40.866965 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:40.866994 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:40.867047 (+ 53us) server_negotiation.cc:407] Connection header received
0810 01:40:40.867685 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:40.867691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:40.868012 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:40.868379 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:40.869735 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.870887 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.872232 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:40.872700 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:40.872882 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:40.875667 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:40.875676 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:40.875694 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:40.875732 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:40.877718 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:40.878412 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:40.878416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:40.878421 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:40.878533 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:40.878939 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:40.878942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:40.878943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:40.879324 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:40.879473 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:40.880029 (+ 556us) server_negotiation.cc:299] Negotiation successful
0810 01:40:40.880354 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":101,"threads_started":1}
W20260810 01:40:40.883948 19725 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 962a707e213643c6b945d90314f27810 (127.24.205.131:40613): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
W20260810 01:40:40.884346 19723 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:40.884421 19723 leader_election.cc:302] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1beda4213c24f468c93ecf19f271ae0; no voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810
I20260810 01:40:40.884763 20329 raft_consensus.cc:2726] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:40:41.505085 20333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:41.504678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:34781)
0810 01:40:41.504936 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:41.504992 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":75,"threads_started":1}
I20260810 01:40:41.644936 20335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:41.644528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:45263)
0810 01:40:41.644793 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:41.644845 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":82,"threads_started":1}
I20260810 01:40:41.831938 20336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:41.831532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:59285)
0810 01:40:41.831773 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:41.831842 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
I20260810 01:40:42.427296 20337 raft_consensus.cc:482] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:42.427460 20337 raft_consensus.cc:504] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:42.427912 20337 leader_election.cc:288] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
W20260810 01:40:42.428918 19723 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
W20260810 01:40:42.429028 19725 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 962a707e213643c6b945d90314f27810 (127.24.205.131:40613): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:42.429104 19725 leader_election.cc:302] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1beda4213c24f468c93ecf19f271ae0; no voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810
I20260810 01:40:42.429273 20337 raft_consensus.cc:2726] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:40:42.506547 20338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:42.506084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:42475)
0810 01:40:42.506378 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:42.506444 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":100,"threads_started":1}
I20260810 01:40:42.646206 20339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:42.645754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:60895)
0810 01:40:42.646029 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:42.646111 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":83,"threads_started":1}
I20260810 01:40:42.833137 20340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:42.832712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:41577)
0810 01:40:42.832993 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:42.833049 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":88,"threads_started":1}
I20260810 01:40:43.507874 20341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:43.507415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:58853)
0810 01:40:43.507714 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:43.507775 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":96,"threads_started":1}
I20260810 01:40:43.647456 20342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:43.647020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:40375)
0810 01:40:43.647297 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:43.647359 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":85,"threads_started":1}
I20260810 01:40:43.834286 20343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:43.833857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:36599)
0810 01:40:43.834127 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:43.834194 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":77,"threads_started":1}
I20260810 01:40:43.963061 20344 raft_consensus.cc:482] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:43.963259 20344 raft_consensus.cc:504] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:43.963747 20344 leader_election.cc:288] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
W20260810 01:40:43.964641 19723 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
W20260810 01:40:43.964736 19725 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 962a707e213643c6b945d90314f27810 (127.24.205.131:40613): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:43.964856 19725 leader_election.cc:302] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1beda4213c24f468c93ecf19f271ae0; no voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810
I20260810 01:40:43.965050 20344 raft_consensus.cc:2726] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:40:44.509358 20345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:44.508815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:43033)
0810 01:40:44.509199 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:44.509258 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":95,"threads_started":1}
I20260810 01:40:44.648619 20347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:44.648240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:37629)
0810 01:40:44.648478 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:44.648531 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":73,"threads_started":1}
I20260810 01:40:44.835546 20349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:44.835037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:45877)
0810 01:40:44.835396 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:44.835455 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":75,"threads_started":1}
I20260810 01:40:45.510855 20350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:45.510337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:38949)
0810 01:40:45.510674 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:45.510736 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":117,"threads_started":1}
I20260810 01:40:45.649761 20351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:45.649350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:45047)
0810 01:40:45.649613 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:45.649670 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":99,"threads_started":1}
I20260810 01:40:45.836776 20352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:45.836282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:57875)
0810 01:40:45.836551 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:45.836609 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
I20260810 01:40:46.364868 20355 raft_consensus.cc:482] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:46.365007 20355 raft_consensus.cc:504] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:46.365482 20355 leader_election.cc:288] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
W20260810 01:40:46.366395 19725 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 962a707e213643c6b945d90314f27810 (127.24.205.131:40613): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
W20260810 01:40:46.366540 19723 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:46.366613 19723 leader_election.cc:302] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1beda4213c24f468c93ecf19f271ae0; no voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810
I20260810 01:40:46.366757 20355 raft_consensus.cc:2726] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:40:46.512207 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:46.511673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:34213)
0810 01:40:46.511948 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:46.512037 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":97,"threads_started":1}
I20260810 01:40:46.651044 20358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:46.650580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:36199)
0810 01:40:46.650890 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:46.650948 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":76,"threads_started":1}
I20260810 01:40:46.838107 20359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:46.837610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:34165)
0810 01:40:46.837956 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:46.838015 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":77,"threads_started":1}
I20260810 01:40:47.513473 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:47.513037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:35219)
0810 01:40:47.513313 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:47.513373 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":89,"threads_started":1}
I20260810 01:40:47.652442 20362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:47.651920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:53667)
0810 01:40:47.652273 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:47.652342 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":86,"threads_started":1}
I20260810 01:40:47.839282 20365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:47.838865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:46525)
0810 01:40:47.839131 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:47.839190 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":108,"threads_started":1}
I20260810 01:40:48.514711 20366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:48.514298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:40675)
0810 01:40:48.514543 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:48.514613 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260810 01:40:48.653842 20367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:48.653360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:46707)
0810 01:40:48.653678 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:48.653743 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":94,"threads_started":1}
I20260810 01:40:48.840495 20371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:48.840055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:39111)
0810 01:40:48.840341 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:48.840400 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
I20260810 01:40:49.516191 20374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:49.515683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:45841)
0810 01:40:49.515989 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:49.516086 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":75,"threads_started":1}
I20260810 01:40:49.655223 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:49.654743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:56073)
0810 01:40:49.655055 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:49.655115 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":137,"threads_started":1}
I20260810 01:40:49.841732 20378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:49.841323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:52947)
0810 01:40:49.841570 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:49.841628 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":76,"threads_started":1}
I20260810 01:40:50.249539 20379 raft_consensus.cc:482] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:50.249740 20379 raft_consensus.cc:504] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "962a707e213643c6b945d90314f27810" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40613 } } peers { permanent_uuid: "0322282ead2f4fc398ca6561bd2eb635" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 36259 } } peers { permanent_uuid: "c1beda4213c24f468c93ecf19f271ae0" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 41693 } }
I20260810 01:40:50.250166 20379 leader_election.cc:288] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 962a707e213643c6b945d90314f27810 (127.24.205.131:40613), 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259)
W20260810 01:40:50.251127 19723 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0322282ead2f4fc398ca6561bd2eb635 (127.24.205.130:36259): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
W20260810 01:40:50.251221 19725 leader_election.cc:341] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 962a707e213643c6b945d90314f27810 (127.24.205.131:40613): Not found: Tablet not found: dd4693aea93e48efb5f144e7104c9834
I20260810 01:40:50.251267 19723 leader_election.cc:302] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1beda4213c24f468c93ecf19f271ae0; no voters: 0322282ead2f4fc398ca6561bd2eb635, 962a707e213643c6b945d90314f27810
I20260810 01:40:50.251420 20379 raft_consensus.cc:2726] T dd4693aea93e48efb5f144e7104c9834 P c1beda4213c24f468c93ecf19f271ae0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:40:50.517475 20381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:50.517040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:55967)
0810 01:40:50.517317 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:50.517377 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":114,"threads_started":1}
I20260810 01:40:50.656858 20383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:50.656349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:52225)
0810 01:40:50.656666 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:50.656729 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":112,"threads_started":1}
I20260810 01:40:50.843014 20385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:50.842545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:49263)
0810 01:40:50.842849 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:50.842914 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":103,"threads_started":1}
I20260810 01:40:51.518690 20386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:51.518282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:32959)
0810 01:40:51.518535 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:51.518589 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
I20260810 01:40:51.658260 20387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:51.657730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:37257)
0810 01:40:51.658064 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:51.658123 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":98,"threads_started":1}
I20260810 01:40:51.844501 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:51.843937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:37375)
0810 01:40:51.844283 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:51.844351 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":184,"threads_started":1}
I20260810 01:40:52.520139 20392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:52.519600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:33959)
0810 01:40:52.519907 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:52.519973 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":94,"threads_started":1}
I20260810 01:40:52.659487 20393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:52.659036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:47829)
0810 01:40:52.659323 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:52.659385 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":103,"threads_started":1}
I20260810 01:40:52.845834 20394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:52.845372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:54939)
0810 01:40:52.845663 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:52.845728 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":104,"threads_started":1}
I20260810 01:40:53.521668 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:53.521139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:45967)
0810 01:40:53.521469 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:53.521567 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":101,"threads_started":1}
I20260810 01:40:53.660959 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:53.660473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:33743)
0810 01:40:53.660790 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:53.660859 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":101,"threads_started":1}
I20260810 01:40:53.847460 20398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:53.846905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:35909)
0810 01:40:53.847289 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:53.847361 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":128,"threads_started":1}
I20260810 01:40:54.523315 20399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:54.522867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.129:39895)
0810 01:40:54.523146 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:54.523213 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":84,"threads_started":1}
I20260810 01:40:54.662382 20400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:54.661936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.130:60811)
0810 01:40:54.662225 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:54.662284 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":78,"threads_started":1}
I20260810 01:40:54.834794 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 19627
I20260810 01:40:54.852267 20401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:54.849104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:41559 (local address 127.24.205.131:50133)
0810 01:40:54.851940 (+ 2836us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:54.852056 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.190:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2699,"thread_start_us":921,"threads_started":1}
I20260810 01:40:54.862699 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 19908
I20260810 01:40:54.878389 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 20121
2026-08-10T01:40:54Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59877 ms)
[----------] 30 tests from SecurityITest (253749 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:40:54 dist-test-slave-t3q3 krb5kdc[20406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:40:54 dist-test-slave-t3q3 krb5kdc[20406](info): set up 2 sockets
Aug 10 01:40:54 dist-test-slave-t3q3 krb5kdc[20406](info): commencing operation
krb5kdc: starting...
W20260810 01:40:56.151598 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:40:56 dist-test-slave-t3q3 krb5kdc[20406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:40:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:40:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:40:56.283267 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46797
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:46797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:40:56.396394 20426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:56.396680 20426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:56.396754 20426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:56.400635 20426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:40:56.400720 20426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:56.400759 20426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:56.400817 20426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:40:56.400858 20426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:40:56.405957 20426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:46797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:56.406962 20426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:56.408001 20426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:56.416935 20437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:56.416975 20431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:56.417011 20426 server_base.cc:1034] running on GCE node
W20260810 01:40:56.416947 20433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:56.417749 20426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:56.418818 20426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:56.420009 20426 hybrid_clock.cc:648] HybridClock initialized: now 1786326056419991 us; error 30 us; skew 500 ppm
Aug 10 01:40:56 dist-test-slave-t3q3 krb5kdc[20406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326056, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:56.422740 20426 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:40:56.423621 20426 webserver.cc:460] Webserver started at http://127.24.205.190:39849/ using document root <none> and password file <none>
I20260810 01:40:56.424180 20426 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:56.424247 20426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:56.424414 20426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:56.426317 20426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "d50298cc89b445a597498d0c7cd27c24"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "dc342e357e9cea56a00cbff05ccfa3af"
server_key_iv: "3407d6386b048e5623ca45475d9593ba"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.426815 20426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "d50298cc89b445a597498d0c7cd27c24"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "dc342e357e9cea56a00cbff05ccfa3af"
server_key_iv: "3407d6386b048e5623ca45475d9593ba"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.430445 20426 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:40:56.432824 20447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:56.434044 20426 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:40:56.434146 20426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "d50298cc89b445a597498d0c7cd27c24"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "dc342e357e9cea56a00cbff05ccfa3af"
server_key_iv: "3407d6386b048e5623ca45475d9593ba"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.434228 20426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:56.450883 20426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:56.453930 20426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:56.454159 20426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:56.461572 20426 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:46797
I20260810 01:40:56.461598 20530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:46797 every 8 connection(s)
I20260810 01:40:56.462620 20426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:40:56.465507 20531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:56.470288 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 20426
I20260810 01:40:56.470438 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:40:56.470777 25398 external_mini_cluster.cc:1428] Setting key f61e041f54b6c07c8a2695da76e58985
I20260810 01:40:56.471613 20531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24: Bootstrap starting.
I20260810 01:40:56.474071 20531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:56.474812 20531 log.cc:824] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:56.476748 20531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24: No bootstrap required, opened a new log
Aug 10 01:40:56 dist-test-slave-t3q3 krb5kdc[20406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:40:56.480556 20531 raft_consensus.cc:348] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50298cc89b445a597498d0c7cd27c24" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46797 } }
I20260810 01:40:56.480774 20531 raft_consensus.cc:374] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:56.480835 20531 raft_consensus.cc:729] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d50298cc89b445a597498d0c7cd27c24, State: Initialized, Role: FOLLOWER
I20260810 01:40:56.481315 20531 consensus_queue.cc:260] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50298cc89b445a597498d0c7cd27c24" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46797 } }
I20260810 01:40:56.481487 20531 raft_consensus.cc:388] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:40:56.481582 20531 raft_consensus.cc:482] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:40:56.481701 20531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:56.482605 20531 raft_consensus.cc:504] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50298cc89b445a597498d0c7cd27c24" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46797 } }
I20260810 01:40:56.483011 20531 leader_election.cc:302] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d50298cc89b445a597498d0c7cd27c24; no voters:
I20260810 01:40:56.483386 20531 leader_election.cc:288] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:40:56.483492 20536 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:40:56.483769 20536 raft_consensus.cc:686] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [term 1 LEADER]: Becoming Leader. State: Replica: d50298cc89b445a597498d0c7cd27c24, State: Running, Role: LEADER
I20260810 01:40:56.484169 20536 consensus_queue.cc:237] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50298cc89b445a597498d0c7cd27c24" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46797 } }
I20260810 01:40:56.484733 20531 sys_catalog.cc:564] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:40:56.486550 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:56.472318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46622 (local address 127.24.205.190:46797)
0810 01:40:56.472781 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:56.472796 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:56.472832 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:40:56.473471 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:56.473489 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:56.473923 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:56.474330 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:56.475245 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:56.476314 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:56.477274 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:56.477747 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:56.477940 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:56.480701 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:56.480706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:56.480719 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:56.480746 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:56.482706 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:56.483284 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:56.483293 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:56.483305 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:56.483463 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:56.483806 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:56.483809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:56.483811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:56.484340 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:56.484548 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:56.485305 (+ 757us) server_negotiation.cc:299] Negotiation successful
0810 01:40:56.485643 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":133,"threads_started":1}
I20260810 01:40:56.487408 20537 sys_catalog.cc:455] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d50298cc89b445a597498d0c7cd27c24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50298cc89b445a597498d0c7cd27c24" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46797 } } }
I20260810 01:40:56.488384 20537 sys_catalog.cc:458] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [sys.catalog]: This master's current role is: LEADER
I20260810 01:40:56.487979 20539 sys_catalog.cc:455] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d50298cc89b445a597498d0c7cd27c24. Latest consensus state: current_term: 1 leader_uuid: "d50298cc89b445a597498d0c7cd27c24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50298cc89b445a597498d0c7cd27c24" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46797 } } }
I20260810 01:40:56.488709 20539 sys_catalog.cc:458] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24 [sys.catalog]: This master's current role is: LEADER
W20260810 01:40:56.489728 20560 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:40:56.489820 20560 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:40:56.492039 20563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:40:56.493089 20563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:40:56.498871 20563 catalog_manager.cc:1347] Generated new cluster ID: ae2ab533bf8d4144bf6e468126b2afe1
I20260810 01:40:56.498989 20563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:40:56.523900 20563 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:40:56.524937 20563 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:40:56.529780 20563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24: Generated new TSK 0
I20260810 01:40:56.530478 20563 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:40:56.566990 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46797
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:40:56.682184 20580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:56.682438 20580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:56.682480 20580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:56.686882 20580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:56.686956 20580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:56.687058 20580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:40:56.692279 20580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:56.693367 20580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:56.694375 20580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:56.703835 20590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:56.703828 20588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:56.703835 20587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:56.704242 20580 server_base.cc:1034] running on GCE node
I20260810 01:40:56.704663 20580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:56.705269 20580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:56.706459 20580 hybrid_clock.cc:648] HybridClock initialized: now 1786326056706437 us; error 43 us; skew 500 ppm
Aug 10 01:40:56 dist-test-slave-t3q3 krb5kdc[20406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326056, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:56.709302 20580 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:40:56.710126 20580 webserver.cc:460] Webserver started at http://127.24.205.129:38635/ using document root <none> and password file <none>
I20260810 01:40:56.710682 20580 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:56.710774 20580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:56.711004 20580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:56.713071 20580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "96744a8e861346e38fe37dbef30ad3cc"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "af14a7751ce122d76a52adace79dee80"
server_key_iv: "e5f1e7a7e03bba3d314d6df657447a30"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.713670 20580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "96744a8e861346e38fe37dbef30ad3cc"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "af14a7751ce122d76a52adace79dee80"
server_key_iv: "e5f1e7a7e03bba3d314d6df657447a30"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.717437 20580 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:40:56.719807 20599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:56.721063 20580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:40:56.721202 20580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "96744a8e861346e38fe37dbef30ad3cc"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "af14a7751ce122d76a52adace79dee80"
server_key_iv: "e5f1e7a7e03bba3d314d6df657447a30"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.721313 20580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:56.740213 20580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:56.743335 20580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:56.743549 20580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:56.744238 20580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:56.745141 20580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:56.745211 20580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:56.745286 20580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:56.745330 20580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:56.754347 20580 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:40439
I20260810 01:40:56.754382 20785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:40439 every 8 connection(s)
I20260810 01:40:56.755266 20580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:40:56.764463 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 20580
I20260810 01:40:56.764655 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:40:56.765059 25398 external_mini_cluster.cc:1428] Setting key 853e8d5f36cb08fd40788786cdb7c4aa
Aug 10 01:40:56 dist-test-slave-t3q3 krb5kdc[20406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326056, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:40:56.771134 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:56.757209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:55305 (local address 127.24.205.190:46797)
0810 01:40:56.757347 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:56.757351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:56.758272 (+ 921us) server_negotiation.cc:407] Connection header received
0810 01:40:56.759767 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:56.759771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:56.759839 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:56.759928 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:56.761269 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:56.761951 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:56.763577 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:56.763853 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:56.763952 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:56.767126 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:56.767129 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:56.767131 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:56.767157 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:56.768721 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:56.769350 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:56.769356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:56.769360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:56.769467 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:56.769833 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:56.769838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:56.769840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:56.770099 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:56.770220 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:56.770731 (+ 511us) server_negotiation.cc:299] Negotiation successful
0810 01:40:56.770888 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:40:56.771937 20789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:56.757502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46797 (local address 127.24.205.129:55305)
0810 01:40:56.758087 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:56.758136 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:56.759498 (+ 1362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:56.760155 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:56.760162 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:56.760555 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:56.761087 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:56.761101 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:56.762122 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:56.762126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:56.763429 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:56.763440 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:56.764010 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:56.764013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:56.764262 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:56.765019 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:56.765039 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:56.766932 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:56.768848 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:56.768857 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:56.768877 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:56.769240 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:56.769569 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:56.769571 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:56.769573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:56.769736 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:56.770211 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:56.770217 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:56.770473 (+ 256us) client_negotiation.cc:769] Sending connection context
0810 01:40:56.770661 (+ 188us) client_negotiation.cc:240] Negotiation successful
0810 01:40:56.770948 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":127,"threads_started":1}
I20260810 01:40:56.773463 20786 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46797
I20260810 01:40:56.773801 20786 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:56.774508 20786 heartbeater.cc:511] Master 127.24.205.190:46797 requested a full tablet report, sending...
I20260810 01:40:56.776242 20475 ts_manager.cc:194] Registered new tserver with Master: 96744a8e861346e38fe37dbef30ad3cc (127.24.205.129:40439)
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:40:56.777484 20475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:55305
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:40:56.795030 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46797
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:40:56.909442 20792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:56.909775 20792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:56.909857 20792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:56.913942 20792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:56.914018 20792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:56.914105 20792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:40:56.919296 20792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:56.920394 20792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:56.921398 20792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:56.931249 20800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:56.931252 20802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:56.931469 20792 server_base.cc:1034] running on GCE node
W20260810 01:40:56.931696 20805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:56.932142 20792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:56.932768 20792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:56.933959 20792 hybrid_clock.cc:648] HybridClock initialized: now 1786326056933942 us; error 29 us; skew 500 ppm
Aug 10 01:40:56 dist-test-slave-t3q3 krb5kdc[20406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326056, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:56.936661 20792 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:40:56.937537 20792 webserver.cc:460] Webserver started at http://127.24.205.130:33235/ using document root <none> and password file <none>
I20260810 01:40:56.938170 20792 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:56.938263 20792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:56.938501 20792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:56.940547 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "fa14c622ba1a42a6af8a7e32f7be3293"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "30416f825eae3e176c3155e44646adf4"
server_key_iv: "00791b11f81259f12d47e34e9ee233fb"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.941156 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "fa14c622ba1a42a6af8a7e32f7be3293"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "30416f825eae3e176c3155e44646adf4"
server_key_iv: "00791b11f81259f12d47e34e9ee233fb"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.945007 20792 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:40:56.947636 20816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:56.949095 20792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:40:56.949198 20792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "fa14c622ba1a42a6af8a7e32f7be3293"
format_stamp: "Formatted at 2026-08-10 01:40:56 on dist-test-slave-t3q3"
server_key: "30416f825eae3e176c3155e44646adf4"
server_key_iv: "00791b11f81259f12d47e34e9ee233fb"
server_key_version: "encryptionkey@0"
I20260810 01:40:56.949329 20792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:56.982798 20792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:56.986414 20792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:56.986634 20792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:56.987360 20792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:56.988317 20792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:56.988366 20792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:56.988435 20792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:56.988476 20792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:56.997416 20792 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:34733
I20260810 01:40:56.997440 20981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:34733 every 8 connection(s)
I20260810 01:40:56.998338 20792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:40:57.002177 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 20792
I20260810 01:40:57.002329 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:40:57.002614 25398 external_mini_cluster.cc:1428] Setting key 1a6b45a87484143d461b7fce6c6c87de
Aug 10 01:40:57 dist-test-slave-t3q3 krb5kdc[20406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326056, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:40:57.013299 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.000246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:59935 (local address 127.24.205.190:46797)
0810 01:40:57.000406 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.000411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.001302 (+ 891us) server_negotiation.cc:407] Connection header received
0810 01:40:57.002707 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.002711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.002771 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.002882 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:57.004286 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.004812 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.005976 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.006258 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.006371 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.009307 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:57.009311 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:57.009313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:57.009337 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:57.010884 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:57.011554 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:57.011557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:57.011558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:57.011642 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:57.012041 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:57.012043 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:57.012044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:57.012273 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:57.012351 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.013026 (+ 675us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.013158 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:40:57.014731 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.000689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46797 (local address 127.24.205.130:59935)
0810 01:40:57.001148 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.001190 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:57.002496 (+ 1306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:57.003058 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:57.003071 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:57.003516 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:57.004147 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.004165 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.004937 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.004941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.005845 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.005855 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.006413 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.006417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.006592 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.007218 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:57.007234 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:57.009107 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:57.011012 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:57.011021 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:57.011040 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:57.011446 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:57.011740 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:57.011745 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:57.011749 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:57.011940 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:57.012392 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:57.012402 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:57.012747 (+ 345us) client_negotiation.cc:769] Sending connection context
0810 01:40:57.012985 (+ 238us) client_negotiation.cc:240] Negotiation successful
0810 01:40:57.013658 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":118,"threads_started":1}
I20260810 01:40:57.016033 20983 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46797
I20260810 01:40:57.016381 20983 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:57.016978 20983 heartbeater.cc:511] Master 127.24.205.190:46797 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
I20260810 01:40:57.018234 20475 ts_manager.cc:194] Registered new tserver with Master: fa14c622ba1a42a6af8a7e32f7be3293 (127.24.205.130:34733)
I20260810 01:40:57.019117 20475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:59935
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:40:57.033362 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46797
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:40125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:40:57.145787 20991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:57.146076 20991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:57.146162 20991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:57.150104 20991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:57.150159 20991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:57.150252 20991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:40:57.155833 20991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:40125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:57.156899 20991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:57.157902 20991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:57.167580 20999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:57.167693 20991 server_base.cc:1034] running on GCE node
W20260810 01:40:57.167661 21000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:57.167847 21002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:57.168293 20991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:57.168920 20991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:57.170109 20991 hybrid_clock.cc:648] HybridClock initialized: now 1786326057170078 us; error 40 us; skew 500 ppm
Aug 10 01:40:57 dist-test-slave-t3q3 krb5kdc[20406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326057, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:40:57.172912 20991 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:40:57.173724 20991 webserver.cc:460] Webserver started at http://127.24.205.131:44977/ using document root <none> and password file <none>
I20260810 01:40:57.174235 20991 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:57.174295 20991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:57.174456 20991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:57.176482 20991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "60a067f633d548a2941ad65463fbb046"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "7dfd7749ce9a87b8b4fcdd9ff624f4e9"
server_key_iv: "5a672ca6f9a471209d3ff9b0c9f27bee"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.176999 20991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "60a067f633d548a2941ad65463fbb046"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "7dfd7749ce9a87b8b4fcdd9ff624f4e9"
server_key_iv: "5a672ca6f9a471209d3ff9b0c9f27bee"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.180644 20991 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:40:57.182942 21012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:57.184243 20991 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:40:57.184365 20991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "60a067f633d548a2941ad65463fbb046"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "7dfd7749ce9a87b8b4fcdd9ff624f4e9"
server_key_iv: "5a672ca6f9a471209d3ff9b0c9f27bee"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.184509 20991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:57.201881 20991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:57.204852 20991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:57.205017 20991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:57.205579 20991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:57.206398 20991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:57.206445 20991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:57.206496 20991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:57.206563 20991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:57.215934 20991 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:38773
I20260810 01:40:57.215960 21188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:38773 every 8 connection(s)
I20260810 01:40:57.217094 20991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:40:57.220250 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 20991
I20260810 01:40:57.220395 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:40:57.220770 25398 external_mini_cluster.cc:1428] Setting key 57d75d63e4b0ad929ed6f7b5dc0edec3
Aug 10 01:40:57 dist-test-slave-t3q3 krb5kdc[20406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326057, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:40:57.231671 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.219096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:60823 (local address 127.24.205.190:46797)
0810 01:40:57.219245 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.219249 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.220200 (+ 951us) server_negotiation.cc:407] Connection header received
0810 01:40:57.221937 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.221940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.221990 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.222118 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:57.223514 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.224103 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.225285 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.225537 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.225639 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.228209 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:57.228213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:57.228215 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:57.228239 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:57.229874 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:57.230355 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:57.230358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:57.230359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:57.230435 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:57.230743 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:57.230745 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:57.230747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:57.230917 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:57.230994 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.231445 (+ 451us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.231543 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:40:57.232583 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.219475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46797 (local address 127.24.205.131:60823)
0810 01:40:57.219983 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.220047 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:57.221724 (+ 1677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:57.222323 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:57.222333 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:57.222741 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:57.223383 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.223399 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.224225 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.224228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.225175 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.225185 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.225732 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.225735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.225894 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.226480 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:40:57.226498 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:57.228001 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:57.229979 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:57.229984 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:57.229996 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:57.230260 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:57.230518 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:40:57.230520 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:40:57.230521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:40:57.230663 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:40:57.231005 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:57.231010 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:57.231240 (+ 230us) client_negotiation.cc:769] Sending connection context
0810 01:40:57.231394 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:40:57.231655 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":110,"threads_started":1}
I20260810 01:40:57.233803 21190 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46797
I20260810 01:40:57.234068 21190 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:57.234695 21190 heartbeater.cc:511] Master 127.24.205.190:46797 requested a full tablet report, sending...
I20260810 01:40:57.235687 20475 ts_manager.cc:194] Registered new tserver with Master: 60a067f633d548a2941ad65463fbb046 (127.24.205.131:38773)
I20260810 01:40:57.236326 20475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:60823
I20260810 01:40:57.246565 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:40:57.256582 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.248692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46624 (local address 127.24.205.190:46797)
0810 01:40:57.248838 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.248843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.248985 (+ 142us) server_negotiation.cc:407] Connection header received
0810 01:40:57.249093 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.249096 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.249138 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.249236 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:57.249975 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.250500 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.251372 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.251589 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.251701 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.253343 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:57.253347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:57.253350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:40:57.253377 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:57.254845 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:57.255291 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:57.255295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:57.255297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:57.255383 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:40:57.255662 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:40:57.255666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:40:57.255668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:40:57.255901 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:57.256048 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.256348 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.256460 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:40:57.259295 20475 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46624:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:40:57.262373 20475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:40:57.276976 21206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.270847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:40439 (local address 127.0.0.1:44190)
0810 01:40:57.271473 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.271527 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:57.271680 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:57.272670 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:57.272677 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:57.272699 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:57.272847 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.272855 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.274143 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.274148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.275435 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.275445 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.276446 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.276450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.276555 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.276593 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 01:40:57.276711 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 01:40:57.276830 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":3,"thread_start_us":84,"threads_started":1}
I20260810 01:40:57.276988 21207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.271076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44190 (local address 127.24.205.129:40439)
0810 01:40:57.272189 (+ 1113us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.272206 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.272233 (+ 27us) server_negotiation.cc:407] Connection header received
0810 01:40:57.272315 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.272324 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.272504 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.272681 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:57.272982 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.274036 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.275568 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.276336 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.276454 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.276605 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.276740 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.276833 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":981,"thread_start_us":81,"threads_started":1}
I20260810 01:40:57.277688 21213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.271688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:38773 (local address 127.0.0.1:39944)
0810 01:40:57.272867 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.272881 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:57.273052 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:57.273575 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:57.273577 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:57.273597 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:57.273670 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.273676 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.274986 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.274989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.276122 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.276134 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.277292 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.277298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.277390 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.277415 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:40:57.277492 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:40:57.277559 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1098,"mutex_wait_us":17,"thread_start_us":93,"threads_started":1}
I20260810 01:40:57.277808 21215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.271860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39944 (local address 127.24.205.131:38773)
0810 01:40:57.272697 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.272708 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.272960 (+ 252us) server_negotiation.cc:407] Connection header received
0810 01:40:57.273242 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.273247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.273432 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.273593 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:57.273784 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.274849 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.276257 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.277158 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.277289 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.277404 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.277522 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.277636 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":167,"threads_started":1}
I20260810 01:40:57.280469 20675 tablet_service.cc:1467] Processing CreateTablet for tablet 0164438fe8f74a3497ac0b87ae632dad (DEFAULT_TABLE table=test-table [id=7eb2d155b4704de282933973ed21de61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:57.280470 21088 tablet_service.cc:1467] Processing CreateTablet for tablet 0164438fe8f74a3497ac0b87ae632dad (DEFAULT_TABLE table=test-table [id=7eb2d155b4704de282933973ed21de61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:57.281654 20675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0164438fe8f74a3497ac0b87ae632dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:57.281654 21088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0164438fe8f74a3497ac0b87ae632dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:57.284461 21210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.271069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:34733 (local address 127.0.0.1:54874)
0810 01:40:57.272327 (+ 1258us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.272337 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:57.272448 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:57.273160 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:57.273163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:57.273186 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:57.273270 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.273276 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.274851 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.274855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.276224 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.276236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.277660 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.277664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.278018 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.284137 (+ 6119us) client_negotiation.cc:769] Sending connection context
0810 01:40:57.284232 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 01:40:57.284312 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1189,"mutex_wait_us":93,"thread_start_us":120,"threads_started":1}
I20260810 01:40:57.284799 21214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.271752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54874 (local address 127.24.205.130:34733)
0810 01:40:57.272122 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.272137 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.272428 (+ 291us) server_negotiation.cc:407] Connection header received
0810 01:40:57.272577 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.272582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.273016 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.273181 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:57.273368 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.274703 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.276365 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.277522 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.284184 (+ 6662us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.284334 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.284379 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.284454 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":164,"threads_started":1}
I20260810 01:40:57.287698 20888 tablet_service.cc:1467] Processing CreateTablet for tablet 0164438fe8f74a3497ac0b87ae632dad (DEFAULT_TABLE table=test-table [id=7eb2d155b4704de282933973ed21de61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:57.288735 20888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0164438fe8f74a3497ac0b87ae632dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:57.289638 21219 tablet_bootstrap.cc:492] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc: Bootstrap starting.
I20260810 01:40:57.290056 21216 tablet_bootstrap.cc:492] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Bootstrap starting.
I20260810 01:40:57.292523 21216 tablet_bootstrap.cc:654] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:57.292549 21219 tablet_bootstrap.cc:654] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:57.293397 21219 log.cc:824] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:57.293905 21216 log.cc:824] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:57.295326 21219 tablet_bootstrap.cc:492] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc: No bootstrap required, opened a new log
I20260810 01:40:57.295545 21219 ts_tablet_manager.cc:1397] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260810 01:40:57.295833 21216 tablet_bootstrap.cc:492] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: No bootstrap required, opened a new log
I20260810 01:40:57.296010 21216 ts_tablet_manager.cc:1397] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:40:57.298775 21216 raft_consensus.cc:348] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.298977 21216 raft_consensus.cc:374] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:57.299018 21216 raft_consensus.cc:729] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a067f633d548a2941ad65463fbb046, State: Initialized, Role: FOLLOWER
I20260810 01:40:57.298910 21219 raft_consensus.cc:348] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.299208 21219 raft_consensus.cc:374] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:57.299265 21219 raft_consensus.cc:729] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96744a8e861346e38fe37dbef30ad3cc, State: Initialized, Role: FOLLOWER
I20260810 01:40:57.299532 21216 consensus_queue.cc:260] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.299692 21219 consensus_queue.cc:260] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.300045 21225 tablet_bootstrap.cc:492] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Bootstrap starting.
I20260810 01:40:57.300390 20786 heartbeater.cc:503] Master 127.24.205.190:46797 was elected leader, sending a full tablet report...
I20260810 01:40:57.300616 21216 ts_tablet_manager.cc:1428] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:40:57.300700 21219 ts_tablet_manager.cc:1428] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:40:57.300915 21190 heartbeater.cc:503] Master 127.24.205.190:46797 was elected leader, sending a full tablet report...
I20260810 01:40:57.302683 21225 tablet_bootstrap.cc:654] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:57.303967 21225 log.cc:824] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:57.306118 21225 tablet_bootstrap.cc:492] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: No bootstrap required, opened a new log
I20260810 01:40:57.306322 21225 ts_tablet_manager.cc:1397] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 01:40:57.309437 21225 raft_consensus.cc:348] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.309688 21225 raft_consensus.cc:374] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:57.309777 21225 raft_consensus.cc:729] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa14c622ba1a42a6af8a7e32f7be3293, State: Initialized, Role: FOLLOWER
I20260810 01:40:57.310171 21225 consensus_queue.cc:260] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.310838 20983 heartbeater.cc:503] Master 127.24.205.190:46797 was elected leader, sending a full tablet report...
I20260810 01:40:57.311066 21225 ts_tablet_manager.cc:1428] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260810 01:40:57.374671 21233 raft_consensus.cc:482] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:57.374935 21233 raft_consensus.cc:504] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.376171 21233 leader_election.cc:288] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96744a8e861346e38fe37dbef30ad3cc (127.24.205.129:40439), 60a067f633d548a2941ad65463fbb046 (127.24.205.131:38773)
I20260810 01:40:57.381731 21207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.376570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:41985 (local address 127.24.205.129:40439)
0810 01:40:57.376683 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.376688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.377193 (+ 505us) server_negotiation.cc:407] Connection header received
0810 01:40:57.377255 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.377260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.377314 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.377390 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:57.377633 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.378419 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.380408 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.381035 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.381172 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.381228 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.381520 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.381596 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 01:40:57.381731 21215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.376926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:52985 (local address 127.24.205.131:38773)
0810 01:40:57.377050 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.377053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.377069 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:40:57.377119 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.377121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.377190 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.377289 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:57.377633 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.378420 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.380408 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.381035 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.381172 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.381228 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.381520 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.381599 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:40:57.381757 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.376431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:38773 (local address 127.24.205.130:52985)
0810 01:40:57.376647 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.376674 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:57.376771 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:57.377322 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:57.377324 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:57.377339 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:57.377492 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.377502 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.378554 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.378558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.380267 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.380277 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.381182 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.381185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.381334 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.381404 (+ 70us) client_negotiation.cc:769] Sending connection context
0810 01:40:57.381481 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:40:57.381597 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":261}
I20260810 01:40:57.381765 21234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.376431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:40439 (local address 127.24.205.130:41985)
0810 01:40:57.377095 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.377106 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:57.377189 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:57.377411 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:57.377413 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:57.377425 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:57.377521 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.377529 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.378554 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.378558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.380264 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:57.380277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.381177 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.381181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:57.381329 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.381399 (+ 70us) client_negotiation.cc:769] Sending connection context
0810 01:40:57.381481 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 01:40:57.381594 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":244,"thread_start_us":147,"threads_started":1}
I20260810 01:40:57.382568 20708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0164438fe8f74a3497ac0b87ae632dad" candidate_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96744a8e861346e38fe37dbef30ad3cc" is_pre_election: true
I20260810 01:40:57.382558 21117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0164438fe8f74a3497ac0b87ae632dad" candidate_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a067f633d548a2941ad65463fbb046" is_pre_election: true
I20260810 01:40:57.382896 21117 raft_consensus.cc:2454] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa14c622ba1a42a6af8a7e32f7be3293 in term 0.
I20260810 01:40:57.382896 20708 raft_consensus.cc:2454] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa14c622ba1a42a6af8a7e32f7be3293 in term 0.
I20260810 01:40:57.383430 20819 leader_election.cc:302] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a067f633d548a2941ad65463fbb046, fa14c622ba1a42a6af8a7e32f7be3293; no voters:
I20260810 01:40:57.383695 21233 raft_consensus.cc:2781] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:40:57.383783 21233 raft_consensus.cc:482] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:40:57.383816 21233 raft_consensus.cc:3037] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:57.384974 21233 raft_consensus.cc:504] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.385329 21233 leader_election.cc:288] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [CANDIDATE]: Term 1 election: Requested vote from peers 96744a8e861346e38fe37dbef30ad3cc (127.24.205.129:40439), 60a067f633d548a2941ad65463fbb046 (127.24.205.131:38773)
I20260810 01:40:57.385911 21117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0164438fe8f74a3497ac0b87ae632dad" candidate_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a067f633d548a2941ad65463fbb046"
I20260810 01:40:57.385946 20708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0164438fe8f74a3497ac0b87ae632dad" candidate_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96744a8e861346e38fe37dbef30ad3cc"
I20260810 01:40:57.386050 21117 raft_consensus.cc:3037] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:57.386052 20708 raft_consensus.cc:3037] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:57.387429 20708 raft_consensus.cc:2454] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa14c622ba1a42a6af8a7e32f7be3293 in term 1.
I20260810 01:40:57.387429 21117 raft_consensus.cc:2454] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa14c622ba1a42a6af8a7e32f7be3293 in term 1.
I20260810 01:40:57.387728 20819 leader_election.cc:302] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a067f633d548a2941ad65463fbb046, fa14c622ba1a42a6af8a7e32f7be3293; no voters:
I20260810 01:40:57.387897 21233 raft_consensus.cc:2781] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:40:57.388212 21233 raft_consensus.cc:686] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 1 LEADER]: Becoming Leader. State: Replica: fa14c622ba1a42a6af8a7e32f7be3293, State: Running, Role: LEADER
I20260810 01:40:57.388590 21233 consensus_queue.cc:237] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } }
I20260810 01:40:57.391956 20472 catalog_manager.cc:5495] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa14c622ba1a42a6af8a7e32f7be3293 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa14c622ba1a42a6af8a7e32f7be3293" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 } health_report { overall_health: UNKNOWN } } }
I20260810 01:40:57.428618 21214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.424446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54886 (local address 127.24.205.130:34733)
0810 01:40:57.424606 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.424610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.424626 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:40:57.424791 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.424795 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.424903 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.425023 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:40:57.425334 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.426158 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.427057 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.427293 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.427402 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.427745 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:40:57.428240 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:40:57.428378 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.428415 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.428472 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 01:40:57.437698 21117 raft_consensus.cc:1261] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 1 FOLLOWER]: Refusing update from remote peer fa14c622ba1a42a6af8a7e32f7be3293: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:40:57.438339 20708 raft_consensus.cc:1261] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 1 FOLLOWER]: Refusing update from remote peer fa14c622ba1a42a6af8a7e32f7be3293: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:40:57.438544 21233 consensus_queue.cc:1035] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a067f633d548a2941ad65463fbb046" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 38773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:40:57.439096 21237 consensus_queue.cc:1035] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96744a8e861346e38fe37dbef30ad3cc" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 40439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:40:57.456652 20475 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:40:57.456854 20475 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:40:57.459259 20475 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d50298cc89b445a597498d0c7cd27c24: Sending DeleteTablet for 3 replicas of tablet 0164438fe8f74a3497ac0b87ae632dad
I20260810 01:40:57.460018 20675 tablet_service.cc:1514] Processing DeleteTablet for tablet 0164438fe8f74a3497ac0b87ae632dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:57 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:44190
I20260810 01:40:57.460141 20888 tablet_service.cc:1514] Processing DeleteTablet for tablet 0164438fe8f74a3497ac0b87ae632dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:57 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:54874
I20260810 01:40:57.460553 21264 tablet_replica.cc:330] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc: stopping tablet replica
I20260810 01:40:57.460543 21088 tablet_service.cc:1514] Processing DeleteTablet for tablet 0164438fe8f74a3497ac0b87ae632dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:57 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:39944
I20260810 01:40:57.460968 21264 raft_consensus.cc:2229] T 0164438fe8f74a3497ac0b87ae632dad P 96744a8e861346e38fe37dbef30ad3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:40:57.461158 21265 tablet_replica.cc:330] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: stopping tablet replica
I20260810 01:40:57.461437 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 20580
I20260810 01:40:57.461572 21265 raft_consensus.cc:2229] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:40:57.469645 21265 raft_consensus.cc:2258] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:57.472730 21265 ts_tablet_manager.cc:1905] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:40:57.476171 21265 ts_tablet_manager.cc:1918] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:40:57.476302 21265 log.cc:1196] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/0164438fe8f74a3497ac0b87ae632dad
I20260810 01:40:57.476717 21265 ts_tablet_manager.cc:1939] T 0164438fe8f74a3497ac0b87ae632dad P fa14c622ba1a42a6af8a7e32f7be3293: Deleting consensus metadata
I20260810 01:40:57.480659 20452 catalog_manager.cc:4841] TS fa14c622ba1a42a6af8a7e32f7be3293 (127.24.205.130:34733): tablet 0164438fe8f74a3497ac0b87ae632dad (table test-table [id=7eb2d155b4704de282933973ed21de61]) successfully deleted
I20260810 01:40:57.481668 21266 tablet_replica.cc:330] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: stopping tablet replica
I20260810 01:40:57.482084 21266 raft_consensus.cc:2229] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:40:57.482486 21266 raft_consensus.cc:2258] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:57.484174 21266 ts_tablet_manager.cc:1905] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:40:57.487800 21266 ts_tablet_manager.cc:1918] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:40:57.487963 21266 log.cc:1196] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/0164438fe8f74a3497ac0b87ae632dad
I20260810 01:40:57.488476 21266 ts_tablet_manager.cc:1939] T 0164438fe8f74a3497ac0b87ae632dad P 60a067f633d548a2941ad65463fbb046: Deleting consensus metadata
W20260810 01:40:57.489337 20448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:40439 (error 108)
I20260810 01:40:57.489982 20449 catalog_manager.cc:4841] TS 60a067f633d548a2941ad65463fbb046 (127.24.205.131:38773): tablet 0164438fe8f74a3497ac0b87ae632dad (table test-table [id=7eb2d155b4704de282933973ed21de61]) successfully deleted
I20260810 01:40:57.490339 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 20792
I20260810 01:40:57.496824 21210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.496517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:40439 (local address 127.0.0.1:44204)
0810 01:40:57.496670 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:57.496743 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:40439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260810 01:40:57.497027 20448 catalog_manager.cc:4584] TS 96744a8e861346e38fe37dbef30ad3cc (127.24.205.129:40439): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0164438fe8f74a3497ac0b87ae632dad: Network error: Client connection negotiation failed: client connection to 127.24.205.129:40439: connect: Connection refused (error 111)
I20260810 01:40:57.501642 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 20991
I20260810 01:40:57.514111 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 20426
2026-08-10T01:40:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2629 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T01:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:40:57Z Disabled control of system clock
I20260810 01:40:57.552736 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34315
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:36557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:34315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:40:57.666646 21272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:57.666908 21272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:57.666944 21272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:57.671083 21272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:40:57.671142 21272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:57.671162 21272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:57.671180 21272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:40:57.671226 21272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:40:57.676034 21272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:34315
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:57.677241 21272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:57.678779 21272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:57.687599 21282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:57.687628 21280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:57.687599 21286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:57.687917 21272 server_base.cc:1034] running on GCE node
I20260810 01:40:57.688586 21272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:57.689754 21272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:57.690948 21272 hybrid_clock.cc:648] HybridClock initialized: now 1786326057690924 us; error 48 us; skew 500 ppm
I20260810 01:40:57.692844 21272 webserver.cc:460] Webserver started at http://127.24.205.190:36285/ using document root <none> and password file <none>
I20260810 01:40:57.693462 21272 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:57.693562 21272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:57.693813 21272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:57.695888 21272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "564cfd7c687c43cf9de9cd16685569df"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "50cfd45b452febcd6333463475f575f4"
server_key_iv: "92d7e88bf1a3fcd52f4d3d053d485b88"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.696543 21272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "564cfd7c687c43cf9de9cd16685569df"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "50cfd45b452febcd6333463475f575f4"
server_key_iv: "92d7e88bf1a3fcd52f4d3d053d485b88"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.700289 21272 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:40:57.702584 21294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:57.703742 21272 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:40:57.703884 21272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "564cfd7c687c43cf9de9cd16685569df"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "50cfd45b452febcd6333463475f575f4"
server_key_iv: "92d7e88bf1a3fcd52f4d3d053d485b88"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.703997 21272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:57.729594 21272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:57.730358 21272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:57.730577 21272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:57.737887 21272 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:34315
I20260810 01:40:57.737895 21385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:34315 every 8 connection(s)
I20260810 01:40:57.738848 21272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:40:57.742115 21387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:57.747604 21387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df: Bootstrap starting.
I20260810 01:40:57.749188 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 21272
I20260810 01:40:57.749325 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:40:57.749639 25398 external_mini_cluster.cc:1428] Setting key 7ae5fe716f05c1e749196c1e5fdf5fde
I20260810 01:40:57.750471 21387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:57.751385 21387 log.cc:824] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:57.753445 21387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df: No bootstrap required, opened a new log
I20260810 01:40:57.757061 21387 raft_consensus.cc:348] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564cfd7c687c43cf9de9cd16685569df" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34315 } }
I20260810 01:40:57.757313 21387 raft_consensus.cc:374] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:57.757409 21387 raft_consensus.cc:729] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564cfd7c687c43cf9de9cd16685569df, State: Initialized, Role: FOLLOWER
I20260810 01:40:57.757890 21387 consensus_queue.cc:260] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564cfd7c687c43cf9de9cd16685569df" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34315 } }
I20260810 01:40:57.758046 21387 raft_consensus.cc:388] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:40:57.758114 21387 raft_consensus.cc:482] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:40:57.758229 21387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:57.759112 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:57.750871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41766 (local address 127.24.205.190:34315)
0810 01:40:57.751585 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:57.751602 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:57.751640 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:40:57.752501 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:57.752522 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:57.752863 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:57.753225 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:57.753704 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.754675 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.755604 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:57.756149 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:57.756328 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:57.757219 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:57.757224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:57.757237 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:40:57.757740 (+ 503us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:57.757800 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:40:57.757821 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:57.757933 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:57.758083 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 01:40:57.758381 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":149,"threads_started":1}
I20260810 01:40:57.759142 21387 raft_consensus.cc:504] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564cfd7c687c43cf9de9cd16685569df" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34315 } }
I20260810 01:40:57.759541 21387 leader_election.cc:302] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 564cfd7c687c43cf9de9cd16685569df; no voters:
I20260810 01:40:57.759892 21387 leader_election.cc:288] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:40:57.760006 21395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:40:57.760280 21395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [term 1 LEADER]: Becoming Leader. State: Replica: 564cfd7c687c43cf9de9cd16685569df, State: Running, Role: LEADER
I20260810 01:40:57.760584 21395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564cfd7c687c43cf9de9cd16685569df" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34315 } }
I20260810 01:40:57.761093 21387 sys_catalog.cc:564] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:40:57.762055 21397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 564cfd7c687c43cf9de9cd16685569df. Latest consensus state: current_term: 1 leader_uuid: "564cfd7c687c43cf9de9cd16685569df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564cfd7c687c43cf9de9cd16685569df" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34315 } } }
I20260810 01:40:57.762295 21397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [sys.catalog]: This master's current role is: LEADER
I20260810 01:40:57.762437 21396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "564cfd7c687c43cf9de9cd16685569df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564cfd7c687c43cf9de9cd16685569df" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34315 } } }
I20260810 01:40:57.762545 21396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df [sys.catalog]: This master's current role is: LEADER
I20260810 01:40:57.762826 21405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:40:57.765937 21405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:40:57.771446 21405 catalog_manager.cc:1347] Generated new cluster ID: aba6094c4d1a4c1db451bf73e066419e
I20260810 01:40:57.771536 21405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:40:57.788702 21405 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:40:57.790064 21405 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:40:57.804352 21405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df: Generated new TSK 0
I20260810 01:40:57.805271 21405 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:40:57.819345 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34315
--builtin_ntp_servers=127.24.205.148:36557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:40:57.937296 21420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:57.937529 21420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:57.937565 21420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:57.941576 21420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:57.941625 21420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:57.941708 21420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:40:57.946599 21420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:57.947659 21420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:57.949081 21420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:57.958793 21426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:57.958806 21427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:57.958956 21420 server_base.cc:1034] running on GCE node
W20260810 01:40:57.959019 21434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:57.959568 21420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:57.960213 21420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:57.961408 21420 hybrid_clock.cc:648] HybridClock initialized: now 1786326057961387 us; error 30 us; skew 500 ppm
I20260810 01:40:57.963330 21420 webserver.cc:460] Webserver started at http://127.24.205.129:45907/ using document root <none> and password file <none>
I20260810 01:40:57.963905 21420 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:57.963968 21420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:57.964236 21420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:57.966269 21420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "abac127eade54a30a60a293fd99460c6"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "e962bfdab7066efec1057658db598193"
server_key_iv: "4c4b8f6ebc24de0803e483cc8c4057de"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.966833 21420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "abac127eade54a30a60a293fd99460c6"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "e962bfdab7066efec1057658db598193"
server_key_iv: "4c4b8f6ebc24de0803e483cc8c4057de"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.970484 21420 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:40:57.972839 21442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:57.973968 21420 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:40:57.974113 21420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "abac127eade54a30a60a293fd99460c6"
format_stamp: "Formatted at 2026-08-10 01:40:57 on dist-test-slave-t3q3"
server_key: "e962bfdab7066efec1057658db598193"
server_key_iv: "4c4b8f6ebc24de0803e483cc8c4057de"
server_key_version: "encryptionkey@0"
I20260810 01:40:57.974218 21420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:57.995415 21420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:57.996227 21420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:57.996438 21420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:57.997073 21420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:57.998068 21420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:57.998117 21420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:57.998193 21420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:57.998224 21420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:58.007424 21420 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:37957
I20260810 01:40:58.007491 21618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:37957 every 8 connection(s)
I20260810 01:40:58.008512 21420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:40:58.017297 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 21420
I20260810 01:40:58.017444 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:40:58.017779 25398 external_mini_cluster.cc:1428] Setting key c34895f09d2c44d4eb2f5c72f173abb9
I20260810 01:40:58.017799 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.010461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:53771 (local address 127.24.205.190:34315)
0810 01:40:58.010616 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.010620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.011828 (+ 1208us) server_negotiation.cc:407] Connection header received
0810 01:40:58.013241 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.013244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.013291 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.013368 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:58.014232 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.014769 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.015880 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.016161 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.016240 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.017270 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:58.017275 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:58.017282 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:40:58.017294 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:58.017314 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:40:58.017321 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:58.017407 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.017580 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.017644 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 01:40:58.018608 21623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.010945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:34315 (local address 127.24.205.129:53771)
0810 01:40:58.011673 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.011714 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.013033 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.013536 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.013542 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.013622 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:58.014099 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.014111 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.014884 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.014886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.015773 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.015783 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.016288 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.016291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.016431 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.016974 (+ 543us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:40:58.016975 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:58.017032 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:40:58.017094 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:58.017409 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:58.017422 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:58.017432 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.017577 (+ 145us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.017847 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":146,"threads_started":1}
I20260810 01:40:58.019906 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34315
--builtin_ntp_servers=127.24.205.148:36557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:40:58.019997 21620 heartbeater.cc:347] Connected to a master server at 127.24.205.190:34315
I20260810 01:40:58.020259 21620 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:58.020778 21620 heartbeater.cc:511] Master 127.24.205.190:34315 requested a full tablet report, sending...
I20260810 01:40:58.022240 21317 ts_manager.cc:194] Registered new tserver with Master: abac127eade54a30a60a293fd99460c6 (127.24.205.129:37957)
I20260810 01:40:58.023389 21317 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.129:53771
W20260810 01:40:58.134630 21624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:58.134954 21624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:58.135043 21624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:58.139168 21624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:58.139263 21624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:58.139358 21624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:40:58.144447 21624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:58.145641 21624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:58.147176 21624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:58.157343 21633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:58.157325 21632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:58.157403 21624 server_base.cc:1034] running on GCE node
W20260810 01:40:58.157325 21642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:58.158095 21624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:58.158738 21624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:58.159904 21624 hybrid_clock.cc:648] HybridClock initialized: now 1786326058159885 us; error 35 us; skew 500 ppm
I20260810 01:40:58.162102 21624 webserver.cc:460] Webserver started at http://127.24.205.130:37239/ using document root <none> and password file <none>
I20260810 01:40:58.162709 21624 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:58.162803 21624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:58.163045 21624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:58.165354 21624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "4431b07fc47f41f3af2d7cb410d0e8d0"
format_stamp: "Formatted at 2026-08-10 01:40:58 on dist-test-slave-t3q3"
server_key: "979198beb9a851786a1f4a4d093d61af"
server_key_iv: "be15bf58680220397a7e032dc7c2dc6a"
server_key_version: "encryptionkey@0"
I20260810 01:40:58.165904 21624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "4431b07fc47f41f3af2d7cb410d0e8d0"
format_stamp: "Formatted at 2026-08-10 01:40:58 on dist-test-slave-t3q3"
server_key: "979198beb9a851786a1f4a4d093d61af"
server_key_iv: "be15bf58680220397a7e032dc7c2dc6a"
server_key_version: "encryptionkey@0"
I20260810 01:40:58.169746 21624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260810 01:40:58.172488 21649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:58.173810 21624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:40:58.173913 21624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "4431b07fc47f41f3af2d7cb410d0e8d0"
format_stamp: "Formatted at 2026-08-10 01:40:58 on dist-test-slave-t3q3"
server_key: "979198beb9a851786a1f4a4d093d61af"
server_key_iv: "be15bf58680220397a7e032dc7c2dc6a"
server_key_version: "encryptionkey@0"
I20260810 01:40:58.174005 21624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:58.185937 21624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:58.186600 21624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:58.186767 21624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:58.187350 21624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:58.188380 21624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:58.188431 21624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:58.188472 21624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:58.188495 21624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:58.197763 21624 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:35371
I20260810 01:40:58.197803 21829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:35371 every 8 connection(s)
I20260810 01:40:58.198755 21624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:40:58.207826 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 21624
I20260810 01:40:58.207984 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:40:58.208348 25398 external_mini_cluster.cc:1428] Setting key bdbbb29493827b524035606723174b85
I20260810 01:40:58.209971 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.201052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:52611 (local address 127.24.205.190:34315)
0810 01:40:58.201221 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.201225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.202477 (+ 1252us) server_negotiation.cc:407] Connection header received
0810 01:40:58.204110 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.204115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.204181 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.204306 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:58.205326 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.205937 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.207316 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.207706 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.207849 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.209328 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:58.209340 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:58.209342 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:40:58.209355 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:58.209378 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:40:58.209388 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:58.209476 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.209754 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.209824 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 01:40:58.210671 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34315
--builtin_ntp_servers=127.24.205.148:36557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:40:58.211229 21833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.201431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:34315 (local address 127.24.205.130:52611)
0810 01:40:58.202305 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.202355 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.203837 (+ 1482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.204506 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.204514 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.204609 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:58.205157 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.205171 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.206102 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.206105 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.207154 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.207165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.207875 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.207878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.208199 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.208983 (+ 784us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:40:58.208985 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:58.209048 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:40:58.209137 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:58.209492 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:58.209504 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:58.209542 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.209706 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.210046 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":143,"threads_started":1}
I20260810 01:40:58.212410 21831 heartbeater.cc:347] Connected to a master server at 127.24.205.190:34315
I20260810 01:40:58.212705 21831 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:58.213301 21831 heartbeater.cc:511] Master 127.24.205.190:34315 requested a full tablet report, sending...
I20260810 01:40:58.214411 21317 ts_manager.cc:194] Registered new tserver with Master: 4431b07fc47f41f3af2d7cb410d0e8d0 (127.24.205.130:35371)
I20260810 01:40:58.215251 21317 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.130:52611
W20260810 01:40:58.325189 21836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:40:58.325431 21836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:40:58.325467 21836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:40:58.329533 21836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:40:58.329593 21836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:40:58.329648 21836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:40:58.334659 21836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:34315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:40:58.335621 21836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:40:58.336944 21836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:40:58.346493 21848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:40:58.346530 21852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:58.346732 21836 server_base.cc:1034] running on GCE node
W20260810 01:40:58.346519 21847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:40:58.347366 21836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:40:58.348001 21836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:40:58.349221 21836 hybrid_clock.cc:648] HybridClock initialized: now 1786326058349204 us; error 28 us; skew 500 ppm
I20260810 01:40:58.351061 21836 webserver.cc:460] Webserver started at http://127.24.205.131:43219/ using document root <none> and password file <none>
I20260810 01:40:58.351646 21836 fs_manager.cc:359] Metadata directory not provided
I20260810 01:40:58.351742 21836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:40:58.351976 21836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:40:58.354226 21836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "b64a08e6b05a4c6990f358dba8c49d15"
format_stamp: "Formatted at 2026-08-10 01:40:58 on dist-test-slave-t3q3"
server_key: "0fec0d74bde09af491125695774996d5"
server_key_iv: "902c23d2a6e1c03cddc1a0c641205bc2"
server_key_version: "encryptionkey@0"
I20260810 01:40:58.354800 21836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "b64a08e6b05a4c6990f358dba8c49d15"
format_stamp: "Formatted at 2026-08-10 01:40:58 on dist-test-slave-t3q3"
server_key: "0fec0d74bde09af491125695774996d5"
server_key_iv: "902c23d2a6e1c03cddc1a0c641205bc2"
server_key_version: "encryptionkey@0"
I20260810 01:40:58.358570 21836 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:40:58.360952 21863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:58.362193 21836 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:40:58.362332 21836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "b64a08e6b05a4c6990f358dba8c49d15"
format_stamp: "Formatted at 2026-08-10 01:40:58 on dist-test-slave-t3q3"
server_key: "0fec0d74bde09af491125695774996d5"
server_key_iv: "902c23d2a6e1c03cddc1a0c641205bc2"
server_key_version: "encryptionkey@0"
I20260810 01:40:58.362440 21836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:40:58.379086 21836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:40:58.379683 21836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:40:58.379868 21836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:40:58.380545 21836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:40:58.381456 21836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:40:58.381531 21836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:58.381599 21836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:40:58.381654 21836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:40:58.390671 21836 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:35039
I20260810 01:40:58.390702 22036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:35039 every 8 connection(s)
I20260810 01:40:58.391549 21836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:40:58.398940 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 21836
I20260810 01:40:58.399057 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:40:58.399376 25398 external_mini_cluster.cc:1428] Setting key 25c6275e97cab0debb387cbf5d63bcff
I20260810 01:40:58.401253 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.393603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:33303 (local address 127.24.205.190:34315)
0810 01:40:58.393748 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.393752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.394732 (+ 980us) server_negotiation.cc:407] Connection header received
0810 01:40:58.396186 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.396190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.396250 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.396362 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:58.397262 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.397804 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.399154 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.399426 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.399556 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.400743 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:58.400746 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:58.400749 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:40:58.400764 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:58.400791 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:40:58.400800 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:58.400884 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.401044 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.401110 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:40:58.402144 22041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.393920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:34315 (local address 127.24.205.131:33303)
0810 01:40:58.394574 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.394613 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.395945 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.396546 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.396553 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.396634 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:40:58.397112 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.397124 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.397938 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.397941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.398972 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.398985 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.399604 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.399609 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.399794 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.400468 (+ 674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:40:58.400470 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:40:58.400511 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:40:58.400575 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:40:58.400887 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:40:58.400898 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:40:58.400907 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.401043 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.401346 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":125,"threads_started":1}
I20260810 01:40:58.403395 22038 heartbeater.cc:347] Connected to a master server at 127.24.205.190:34315
I20260810 01:40:58.403651 22038 heartbeater.cc:464] Registering TS with master...
I20260810 01:40:58.404268 22038 heartbeater.cc:511] Master 127.24.205.190:34315 requested a full tablet report, sending...
I20260810 01:40:58.405292 21317 ts_manager.cc:194] Registered new tserver with Master: b64a08e6b05a4c6990f358dba8c49d15 (127.24.205.131:35039)
I20260810 01:40:58.405876 21317 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.131:33303
I20260810 01:40:58.413453 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:40:58.419137 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.415485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41782 (local address 127.24.205.190:34315)
0810 01:40:58.415635 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.415639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.415777 (+ 138us) server_negotiation.cc:407] Connection header received
0810 01:40:58.415882 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.415884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.415924 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.415990 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:40:58.416271 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.416784 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.417572 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.417789 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.417865 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.418705 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:40:58.418709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:40:58.418711 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:40:58.418722 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:40:58.418740 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:40:58.418747 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:40:58.418804 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.418901 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.418953 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 01:40:58.421931 21317 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41782:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:40:58.424912 21317 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:40:58.438946 22055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.433359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:35371 (local address 127.0.0.1:60938)
0810 01:40:58.434026 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.434066 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.434206 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.435058 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.435064 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.435088 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:58.435229 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.435237 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.436456 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.436461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.437704 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.437714 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.438542 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.438544 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.438624 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.438657 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.438736 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.438823 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":1,"spinlock_wait_cycles":7552,"thread_start_us":118,"threads_started":1}
I20260810 01:40:58.439038 22058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.433652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60938 (local address 127.24.205.130:35371)
0810 01:40:58.434503 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.434522 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.434545 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:40:58.434653 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.434661 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.434883 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.435056 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:58.435369 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.436345 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.437832 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.438420 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.438538 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.438732 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.438783 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.438872 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745,"thread_start_us":144,"threads_started":1}
I20260810 01:40:58.439677 22059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.434120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:37957 (local address 127.0.0.1:33110)
0810 01:40:58.434584 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.434596 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.434674 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.435378 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.435381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.435397 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:58.435485 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.435494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.436929 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.436932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.438222 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.438228 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.439291 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.439297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.439406 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.439432 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.439496 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.439564 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":45,"thread_start_us":103,"threads_started":1}
I20260810 01:40:58.439765 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.434538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33110 (local address 127.24.205.129:37957)
0810 01:40:58.434894 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.434903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.434923 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:40:58.435014 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.435020 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.435223 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.435373 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:58.435582 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.436788 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.438354 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.439166 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.439301 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.439475 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.439530 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.439617 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":134,"threads_started":1}
I20260810 01:40:58.441903 22056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.433190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:35039 (local address 127.0.0.1:43810)
0810 01:40:58.434015 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.434074 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.434206 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.435548 (+ 1342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.435551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.435570 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:58.435664 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.435670 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.437034 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.437038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.438214 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.438227 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.441503 (+ 3276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.441506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.441608 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.441630 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.441699 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.441768 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":42,"spinlock_wait_cycles":2688,"thread_start_us":79,"threads_started":1}
I20260810 01:40:58.441970 22057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.433354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43810 (local address 127.24.205.131:35039)
0810 01:40:58.434903 (+ 1549us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.434916 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.434943 (+ 27us) server_negotiation.cc:407] Connection header received
0810 01:40:58.435022 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.435027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.435224 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.435396 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:58.435800 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.436919 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.440548 (+ 3629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.441368 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.441514 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.441680 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.441728 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.441816 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1043,"thread_start_us":144,"threads_started":1}
I20260810 01:40:58.442641 21519 tablet_service.cc:1467] Processing CreateTablet for tablet d6c4bbad469e48e09029bc83683bcc8a (DEFAULT_TABLE table=test-table [id=cffedb9ff109445781df79c58a79ad51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:58.442641 21726 tablet_service.cc:1467] Processing CreateTablet for tablet d6c4bbad469e48e09029bc83683bcc8a (DEFAULT_TABLE table=test-table [id=cffedb9ff109445781df79c58a79ad51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:58.443831 21519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6c4bbad469e48e09029bc83683bcc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:58.443831 21726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6c4bbad469e48e09029bc83683bcc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:58.444612 21934 tablet_service.cc:1467] Processing CreateTablet for tablet d6c4bbad469e48e09029bc83683bcc8a (DEFAULT_TABLE table=test-table [id=cffedb9ff109445781df79c58a79ad51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:40:58.445523 21934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6c4bbad469e48e09029bc83683bcc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:40:58.451249 22062 tablet_bootstrap.cc:492] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Bootstrap starting.
I20260810 01:40:58.452128 22065 tablet_bootstrap.cc:492] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6: Bootstrap starting.
I20260810 01:40:58.453596 22062 tablet_bootstrap.cc:654] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:58.453907 22065 tablet_bootstrap.cc:654] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:58.454581 22062 log.cc:824] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:58.454602 22065 log.cc:824] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:58.455341 22068 tablet_bootstrap.cc:492] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Bootstrap starting.
I20260810 01:40:58.456553 22062 tablet_bootstrap.cc:492] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: No bootstrap required, opened a new log
I20260810 01:40:58.456769 22062 ts_tablet_manager.cc:1397] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:40:58.457106 22068 tablet_bootstrap.cc:654] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Neither blocks nor log segments found. Creating new log.
I20260810 01:40:58.457727 22068 log.cc:824] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:40:58.459756 22068 tablet_bootstrap.cc:492] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: No bootstrap required, opened a new log
I20260810 01:40:58.459756 22065 tablet_bootstrap.cc:492] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6: No bootstrap required, opened a new log
I20260810 01:40:58.459950 22065 ts_tablet_manager.cc:1397] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 01:40:58.459950 22068 ts_tablet_manager.cc:1397] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:40:58.462003 22062 raft_consensus.cc:348] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.462293 22062 raft_consensus.cc:374] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:58.462350 22062 raft_consensus.cc:729] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b64a08e6b05a4c6990f358dba8c49d15, State: Initialized, Role: FOLLOWER
I20260810 01:40:58.462864 22062 consensus_queue.cc:260] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.463526 22038 heartbeater.cc:503] Master 127.24.205.190:34315 was elected leader, sending a full tablet report...
I20260810 01:40:58.463922 22062 ts_tablet_manager.cc:1428] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:40:58.464489 22068 raft_consensus.cc:348] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.464489 22065 raft_consensus.cc:348] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.464747 22065 raft_consensus.cc:374] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:58.464747 22068 raft_consensus.cc:374] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:40:58.464808 22068 raft_consensus.cc:729] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4431b07fc47f41f3af2d7cb410d0e8d0, State: Initialized, Role: FOLLOWER
I20260810 01:40:58.464808 22065 raft_consensus.cc:729] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abac127eade54a30a60a293fd99460c6, State: Initialized, Role: FOLLOWER
I20260810 01:40:58.465253 22065 consensus_queue.cc:260] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.465253 22068 consensus_queue.cc:260] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.466246 22065 ts_tablet_manager.cc:1428] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:40:58.466290 21620 heartbeater.cc:503] Master 127.24.205.190:34315 was elected leader, sending a full tablet report...
I20260810 01:40:58.466336 22068 ts_tablet_manager.cc:1428] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:40:58.466773 21831 heartbeater.cc:503] Master 127.24.205.190:34315 was elected leader, sending a full tablet report...
I20260810 01:40:58.479173 22080 raft_consensus.cc:482] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:40:58.479342 22080 raft_consensus.cc:504] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.480688 22080 leader_election.cc:288] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b64a08e6b05a4c6990f358dba8c49d15 (127.24.205.131:35039), abac127eade54a30a60a293fd99460c6 (127.24.205.129:37957)
I20260810 01:40:58.484452 22057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.480959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:39083 (local address 127.24.205.131:35039)
0810 01:40:58.481102 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.481106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.481120 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:40:58.481264 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.481270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.481325 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.481406 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:58.481746 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.482377 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.483501 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.483891 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.484018 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.484099 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.484273 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.484337 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:40:58.484452 21833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.480846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:35039 (local address 127.24.205.130:39083)
0810 01:40:58.481020 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.481038 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.481130 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.481520 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.481523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.481538 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:58.481638 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.481642 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.482486 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.482490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.483380 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.483390 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.484010 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.484013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.484151 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.484170 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.484259 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.484329 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 01:40:58.484553 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.481242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:48835 (local address 127.24.205.129:37957)
0810 01:40:58.481351 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.481355 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.481550 (+ 195us) server_negotiation.cc:407] Connection header received
0810 01:40:58.481669 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.481675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.481728 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.481812 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:40:58.482079 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.482569 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.483588 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.483979 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.484134 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.484192 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.484363 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.484429 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 01:40:58.484602 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.481159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:37957 (local address 127.24.205.130:48835)
0810 01:40:58.481465 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.481475 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 01:40:58.481588 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:40:58.481825 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:40:58.481828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:40:58.481844 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:40:58.481969 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.481974 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.482692 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.482696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.483460 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:40:58.483469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.484122 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.484126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:40:58.484227 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.484249 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:40:58.484348 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 01:40:58.484417 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":112,"threads_started":1}
I20260810 01:40:58.485195 21961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6c4bbad469e48e09029bc83683bcc8a" candidate_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b64a08e6b05a4c6990f358dba8c49d15" is_pre_election: true
I20260810 01:40:58.485225 21549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6c4bbad469e48e09029bc83683bcc8a" candidate_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abac127eade54a30a60a293fd99460c6" is_pre_election: true
I20260810 01:40:58.485478 21961 raft_consensus.cc:2454] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4431b07fc47f41f3af2d7cb410d0e8d0 in term 0.
I20260810 01:40:58.485534 21549 raft_consensus.cc:2454] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4431b07fc47f41f3af2d7cb410d0e8d0 in term 0.
I20260810 01:40:58.485956 21656 leader_election.cc:302] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4431b07fc47f41f3af2d7cb410d0e8d0, b64a08e6b05a4c6990f358dba8c49d15; no voters:
I20260810 01:40:58.486231 22080 raft_consensus.cc:2781] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:40:58.486320 22080 raft_consensus.cc:482] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:40:58.486366 22080 raft_consensus.cc:3037] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:58.487363 22080 raft_consensus.cc:504] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.487679 22080 leader_election.cc:288] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [CANDIDATE]: Term 1 election: Requested vote from peers b64a08e6b05a4c6990f358dba8c49d15 (127.24.205.131:35039), abac127eade54a30a60a293fd99460c6 (127.24.205.129:37957)
I20260810 01:40:58.488027 21961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6c4bbad469e48e09029bc83683bcc8a" candidate_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b64a08e6b05a4c6990f358dba8c49d15"
I20260810 01:40:58.488104 21549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6c4bbad469e48e09029bc83683bcc8a" candidate_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abac127eade54a30a60a293fd99460c6"
I20260810 01:40:58.488241 21961 raft_consensus.cc:3037] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:58.488267 21549 raft_consensus.cc:3037] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:40:58.489272 21961 raft_consensus.cc:2454] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4431b07fc47f41f3af2d7cb410d0e8d0 in term 1.
I20260810 01:40:58.489348 21549 raft_consensus.cc:2454] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4431b07fc47f41f3af2d7cb410d0e8d0 in term 1.
I20260810 01:40:58.489602 21656 leader_election.cc:302] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4431b07fc47f41f3af2d7cb410d0e8d0, b64a08e6b05a4c6990f358dba8c49d15; no voters:
I20260810 01:40:58.489801 22080 raft_consensus.cc:2781] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:40:58.490046 22080 raft_consensus.cc:686] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4431b07fc47f41f3af2d7cb410d0e8d0, State: Running, Role: LEADER
I20260810 01:40:58.490365 22080 consensus_queue.cc:237] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } }
I20260810 01:40:58.493587 21316 catalog_manager.cc:5495] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4431b07fc47f41f3af2d7cb410d0e8d0 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4431b07fc47f41f3af2d7cb410d0e8d0" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 } health_report { overall_health: UNKNOWN } } }
W20260810 01:40:58.509740 21621 tablet.cc:2369] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:40:58.517359 22058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.513849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60942 (local address 127.24.205.130:35371)
0810 01:40:58.514018 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 01:40:58.514022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:40:58.514034 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:40:58.514101 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:40:58.514103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:40:58.514157 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:40:58.514273 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:40:58.514521 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.515038 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.515883 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:40:58.516142 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:40:58.516224 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:40:58.516494 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:40:58.516895 (+ 401us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:40:58.516986 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:40:58.517105 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 01:40:58.517153 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:40:58.523185 21961 raft_consensus.cc:1261] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 1 FOLLOWER]: Refusing update from remote peer 4431b07fc47f41f3af2d7cb410d0e8d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:40:58.523247 21549 raft_consensus.cc:1261] T d6c4bbad469e48e09029bc83683bcc8a P abac127eade54a30a60a293fd99460c6 [term 1 FOLLOWER]: Refusing update from remote peer 4431b07fc47f41f3af2d7cb410d0e8d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:40:58.523976 22080 consensus_queue.cc:1035] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b64a08e6b05a4c6990f358dba8c49d15" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:40:58.524256 22082 consensus_queue.cc:1035] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abac127eade54a30a60a293fd99460c6" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 37957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:40:58.531770 22093 mvcc.cc:205] Tried to move back new op lower bound from 7316791535703830528 to 7316791535578963968. Current Snapshot: MvccSnapshot[applied={T|T < 7316791535703830528}]
I20260810 01:40:58.539991 21315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:40:58.540203 21315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:40:58.542703 21315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 564cfd7c687c43cf9de9cd16685569df: Sending DeleteTablet for 3 replicas of tablet d6c4bbad469e48e09029bc83683bcc8a
I20260810 01:40:58.543620 21726 tablet_service.cc:1514] Processing DeleteTablet for tablet d6c4bbad469e48e09029bc83683bcc8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:58 UTC) from {username='slave'} at 127.0.0.1:60938
I20260810 01:40:58.543745 21934 tablet_service.cc:1514] Processing DeleteTablet for tablet d6c4bbad469e48e09029bc83683bcc8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:58 UTC) from {username='slave'} at 127.0.0.1:43810
I20260810 01:40:58.544193 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 21420
I20260810 01:40:58.544303 21519 tablet_service.cc:1514] Processing DeleteTablet for tablet d6c4bbad469e48e09029bc83683bcc8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:40:58 UTC) from {username='slave'} at 127.0.0.1:33110
I20260810 01:40:58.545274 22110 tablet_replica.cc:330] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: stopping tablet replica
I20260810 01:40:58.545583 22110 raft_consensus.cc:2229] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:40:58.545852 22110 raft_consensus.cc:2258] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:58.548822 22110 ts_tablet_manager.cc:1905] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:40:58.550782 22105 tablet_replica.cc:330] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: stopping tablet replica
I20260810 01:40:58.551198 22105 raft_consensus.cc:2229] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:40:58.551718 22105 raft_consensus.cc:2258] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:40:58.552181 22110 ts_tablet_manager.cc:1918] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:40:58.552289 22110 log.cc:1196] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/d6c4bbad469e48e09029bc83683bcc8a
I20260810 01:40:58.552630 22110 ts_tablet_manager.cc:1939] T d6c4bbad469e48e09029bc83683bcc8a P b64a08e6b05a4c6990f358dba8c49d15: Deleting consensus metadata
I20260810 01:40:58.553485 22105 ts_tablet_manager.cc:1905] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:40:58.554051 21300 catalog_manager.cc:4841] TS b64a08e6b05a4c6990f358dba8c49d15 (127.24.205.131:35039): tablet d6c4bbad469e48e09029bc83683bcc8a (table test-table [id=cffedb9ff109445781df79c58a79ad51]) successfully deleted
I20260810 01:40:58.556625 22105 ts_tablet_manager.cc:1918] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:40:58.556733 22105 log.cc:1196] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/d6c4bbad469e48e09029bc83683bcc8a
I20260810 01:40:58.557065 22105 ts_tablet_manager.cc:1939] T d6c4bbad469e48e09029bc83683bcc8a P 4431b07fc47f41f3af2d7cb410d0e8d0: Deleting consensus metadata
W20260810 01:40:58.557441 21300 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:37957 (error 108)
I20260810 01:40:58.558357 21295 catalog_manager.cc:4841] TS 4431b07fc47f41f3af2d7cb410d0e8d0 (127.24.205.130:35371): tablet d6c4bbad469e48e09029bc83683bcc8a (table test-table [id=cffedb9ff109445781df79c58a79ad51]) successfully deleted
I20260810 01:40:58.558624 22056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:40:58.558278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:37957 (local address 127.0.0.1:33116)
0810 01:40:58.558445 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 01:40:58.558532 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:37957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260810 01:40:58.558754 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 21624
W20260810 01:40:58.558864 21300 catalog_manager.cc:4584] TS abac127eade54a30a60a293fd99460c6 (127.24.205.129:37957): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d6c4bbad469e48e09029bc83683bcc8a: Network error: Client connection negotiation failed: client connection to 127.24.205.129:37957: connect: Connection refused (error 111)
I20260810 01:40:58.573185 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 21836
I20260810 01:40:58.588151 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 21272
2026-08-10T01:40:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1074 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:40:58 dist-test-slave-t3q3 krb5kdc[22116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:40:58 dist-test-slave-t3q3 krb5kdc[22116](info): set up 2 sockets
Aug 10 01:40:58 dist-test-slave-t3q3 krb5kdc[22116](info): commencing operation
krb5kdc: starting...
W20260810 01:40:59.858398 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:40:59 dist-test-slave-t3q3 krb5kdc[22116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:40:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:40:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:40:59.995222 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37951
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:37951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:00.109176 22136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:00.109459 22136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:00.109499 22136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:00.113503 22136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:00.113575 22136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:00.113595 22136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:00.113613 22136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:00.113628 22136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:00.118875 22136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:37951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:00.119973 22136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:00.121109 22136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:00.129765 22145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:00.129762 22144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:00.129779 22149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:00.130214 22136 server_base.cc:1034] running on GCE node
I20260810 01:41:00.130756 22136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:00.131876 22136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:00.133085 22136 hybrid_clock.cc:648] HybridClock initialized: now 1786326060133064 us; error 36 us; skew 500 ppm
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326060, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:00.140364 22136 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:00.141335 22136 webserver.cc:460] Webserver started at http://127.24.205.190:45593/ using document root <none> and password file <none>
I20260810 01:41:00.141937 22136 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:00.142045 22136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:00.142292 22136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:00.144505 22136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "81dd0cacadeb47dc963799924295475b"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "2ae976c173d5938204232c58ed38ccd1"
server_key_iv: "a839e864afd432a04b703eecb9c5d0d1"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.145186 22136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "81dd0cacadeb47dc963799924295475b"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "2ae976c173d5938204232c58ed38ccd1"
server_key_iv: "a839e864afd432a04b703eecb9c5d0d1"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.149160 22136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:41:00.151676 22163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.153018 22136 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:41:00.153162 22136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "81dd0cacadeb47dc963799924295475b"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "2ae976c173d5938204232c58ed38ccd1"
server_key_iv: "a839e864afd432a04b703eecb9c5d0d1"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.153275 22136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:00.172474 22136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:00.175521 22136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:00.175758 22136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:00.183265 22136 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:37951
I20260810 01:41:00.183290 22249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:37951 every 8 connection(s)
I20260810 01:41:00.184378 22136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:00.187115 22250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:00.192495 22250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b: Bootstrap starting.
I20260810 01:41:00.192873 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 22136
I20260810 01:41:00.193027 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:00.193324 25398 external_mini_cluster.cc:1428] Setting key 00c35ceb59ffb9a82e090672c712e6fb
I20260810 01:41:00.195240 22250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:00.196135 22250 log.cc:824] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:00.198357 22250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b: No bootstrap required, opened a new log
I20260810 01:41:00.202409 22250 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81dd0cacadeb47dc963799924295475b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37951 } }
I20260810 01:41:00.202690 22250 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:00.202762 22250 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81dd0cacadeb47dc963799924295475b, State: Initialized, Role: FOLLOWER
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:00.203274 22250 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81dd0cacadeb47dc963799924295475b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37951 } }
I20260810 01:41:00.203456 22250 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:00.203528 22250 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:00.203639 22250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:00.204831 22250 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81dd0cacadeb47dc963799924295475b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37951 } }
I20260810 01:41:00.205183 22250 leader_election.cc:302] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81dd0cacadeb47dc963799924295475b; no voters:
I20260810 01:41:00.205511 22250 leader_election.cc:288] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:00.205595 22257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:00.205796 22257 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [term 1 LEADER]: Becoming Leader. State: Replica: 81dd0cacadeb47dc963799924295475b, State: Running, Role: LEADER
I20260810 01:41:00.206090 22257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81dd0cacadeb47dc963799924295475b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37951 } }
I20260810 01:41:00.206779 22250 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:00.207262 22257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81dd0cacadeb47dc963799924295475b. Latest consensus state: current_term: 1 leader_uuid: "81dd0cacadeb47dc963799924295475b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81dd0cacadeb47dc963799924295475b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37951 } } }
I20260810 01:41:00.207387 22257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:00.208329 22260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81dd0cacadeb47dc963799924295475b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81dd0cacadeb47dc963799924295475b" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37951 } } }
I20260810 01:41:00.208447 22260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:00.209419 22264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:00.209749 22255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:00.194738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51828 (local address 127.24.205.190:37951)
0810 01:41:00.195195 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:00.195218 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:00.195274 (+ 56us) server_negotiation.cc:407] Connection header received
0810 01:41:00.196189 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:00.196215 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:00.196626 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:00.196935 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:00.197674 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.199129 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.200002 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.200753 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.200939 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:00.203732 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:00.203740 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:00.203759 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:00.203790 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:00.205607 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:00.206263 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:00.206271 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:00.206278 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:00.206416 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:00.206716 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:00.206720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:00.206721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:00.207234 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:00.208051 (+ 817us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:00.208242 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 01:41:00.208550 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":122,"threads_started":1}
I20260810 01:41:00.212785 22264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:00.218609 22264 catalog_manager.cc:1347] Generated new cluster ID: 17ee3bc54acf4c2091ef345dcba4cf07
I20260810 01:41:00.218686 22264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:00.263154 22264 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:00.264544 22264 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:00.270754 22264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b: Generated new TSK 0
I20260810 01:41:00.271502 22264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:41:00.313279 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37951
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:00.431567 22292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:00.431809 22292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:00.431851 22292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:00.435868 22292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:00.435925 22292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:00.436022 22292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:41:00.441262 22292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:00.442284 22292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:00.443316 22292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:00.453032 22304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:00.453012 22292 server_base.cc:1034] running on GCE node
W20260810 01:41:00.453022 22301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:00.452999 22302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:00.453679 22292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:00.454322 22292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:00.455515 22292 hybrid_clock.cc:648] HybridClock initialized: now 1786326060455504 us; error 35 us; skew 500 ppm
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326060, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:00.458730 22292 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:41:00.459597 22292 webserver.cc:460] Webserver started at http://127.24.205.129:39015/ using document root <none> and password file <none>
I20260810 01:41:00.460247 22292 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:00.460345 22292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:00.460583 22292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:00.462630 22292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "f2f4a66bdcd246e1b6dea07564f4ee48"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "f47d666f9b7f4ddbf156fb1975bc6bea"
server_key_iv: "020e7ebb6dbe433d315ed697c23c0bf4"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.463212 22292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "f2f4a66bdcd246e1b6dea07564f4ee48"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "f47d666f9b7f4ddbf156fb1975bc6bea"
server_key_iv: "020e7ebb6dbe433d315ed697c23c0bf4"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.466936 22292 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260810 01:41:00.469388 22315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.470659 22292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:00.470798 22292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "f2f4a66bdcd246e1b6dea07564f4ee48"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "f47d666f9b7f4ddbf156fb1975bc6bea"
server_key_iv: "020e7ebb6dbe433d315ed697c23c0bf4"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.470911 22292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:00.502547 22292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:00.505721 22292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:00.505939 22292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:00.506565 22292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:00.507470 22292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:00.507534 22292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.507575 22292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:00.507591 22292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.517087 22292 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:42769
I20260810 01:41:00.517125 22487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:42769 every 8 connection(s)
I20260810 01:41:00.518051 22292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:00.521010 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 22292
I20260810 01:41:00.521152 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:00.521463 25398 external_mini_cluster.cc:1428] Setting key de574c45b15567f1db7cd1335f9641c0
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326060, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:41:00.533556 22255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:00.520006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:36663 (local address 127.24.205.190:37951)
0810 01:41:00.520191 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:00.520195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:00.521052 (+ 857us) server_negotiation.cc:407] Connection header received
0810 01:41:00.522618 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:00.522622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:00.522678 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:00.522771 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:00.524022 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.524671 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.525986 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.526437 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.526568 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:00.529209 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:00.529216 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:00.529221 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:00.529261 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:00.531134 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:00.531644 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:00.531650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:00.531656 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:00.531766 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:00.532219 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:00.532226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:00.532229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:00.532509 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:00.532643 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:00.533187 (+ 544us) server_negotiation.cc:299] Negotiation successful
0810 01:41:00.533320 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 01:41:00.534310 22491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:00.520407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:37951 (local address 127.24.205.129:36663)
0810 01:41:00.520895 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:00.520941 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:00.522384 (+ 1443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:00.522956 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:00.522963 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:00.523344 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:00.523863 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:00.523878 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.524833 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.524836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:00.525839 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:00.525849 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.526630 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.526633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:00.526807 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:00.527475 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:00.527492 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:00.529019 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:00.531257 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:00.531262 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:00.531274 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:00.531529 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:00.531876 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:00.531879 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:00.531880 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:00.532018 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:00.532628 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:00.532633 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:00.532885 (+ 252us) client_negotiation.cc:769] Sending connection context
0810 01:41:00.533053 (+ 168us) client_negotiation.cc:240] Negotiation successful
0810 01:41:00.533328 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":124,"threads_started":1}
I20260810 01:41:00.535718 22488 heartbeater.cc:347] Connected to a master server at 127.24.205.190:37951
I20260810 01:41:00.536023 22488 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
I20260810 01:41:00.536659 22488 heartbeater.cc:511] Master 127.24.205.190:37951 requested a full tablet report, sending...
I20260810 01:41:00.538218 22191 ts_manager.cc:194] Registered new tserver with Master: f2f4a66bdcd246e1b6dea07564f4ee48 (127.24.205.129:42769)
I20260810 01:41:00.539356 22191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:36663
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:41:00.555284 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37951
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:00.677754 22496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:00.678097 22496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:00.678164 22496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:00.682327 22496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:00.682391 22496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:00.682451 22496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:41:00.687944 22496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:00.689049 22496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:00.690022 22496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:00.699652 22505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:00.699652 22502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:00.699800 22503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:00.700099 22496 server_base.cc:1034] running on GCE node
I20260810 01:41:00.700521 22496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:00.701160 22496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:00.702349 22496 hybrid_clock.cc:648] HybridClock initialized: now 1786326060702315 us; error 46 us; skew 500 ppm
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326060, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:00.705152 22496 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:41:00.706014 22496 webserver.cc:460] Webserver started at http://127.24.205.130:45837/ using document root <none> and password file <none>
I20260810 01:41:00.706590 22496 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:00.706684 22496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:00.706923 22496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:00.709225 22496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "a2e16aaa7c6a434e9b9febc6db42b867"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "cc3800265d07c1a74df7a3cee6cff739"
server_key_iv: "4bdb4a88a28679c167a549a6182b30b5"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.709812 22496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "a2e16aaa7c6a434e9b9febc6db42b867"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "cc3800265d07c1a74df7a3cee6cff739"
server_key_iv: "4bdb4a88a28679c167a549a6182b30b5"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.713603 22496 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:41:00.716172 22523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.717553 22496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:00.717720 22496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "a2e16aaa7c6a434e9b9febc6db42b867"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "cc3800265d07c1a74df7a3cee6cff739"
server_key_iv: "4bdb4a88a28679c167a549a6182b30b5"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.717842 22496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:00.739689 22496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:00.742806 22496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:00.743017 22496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:00.743646 22496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:00.744598 22496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:00.744669 22496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.744743 22496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:00.744796 22496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.754153 22496 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:42035
I20260810 01:41:00.754172 22685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:42035 every 8 connection(s)
I20260810 01:41:00.755090 22496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:41:00.763725 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 22496
I20260810 01:41:00.763891 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:41:00.764266 25398 external_mini_cluster.cc:1428] Setting key e6122a0c772deb8d67dd89e4cce5dd13
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326060, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:00.770052 22255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:00.757048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:41757 (local address 127.24.205.190:37951)
0810 01:41:00.757217 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:00.757220 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:00.758134 (+ 914us) server_negotiation.cc:407] Connection header received
0810 01:41:00.759431 (+ 1297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:00.759434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:00.759484 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:00.759569 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:00.760983 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.761533 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.762716 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.762936 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.763020 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:00.765902 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:00.765906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:00.765909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:00.765937 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:00.767635 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:00.768231 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:00.768236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:00.768237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:00.768329 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:00.768704 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:00.768708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:00.768710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:00.768935 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:00.769038 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:00.769709 (+ 671us) server_negotiation.cc:299] Negotiation successful
0810 01:41:00.769844 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 01:41:00.771178 22689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:00.757482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:37951 (local address 127.24.205.130:41757)
0810 01:41:00.757972 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:00.758017 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:00.759222 (+ 1205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:00.759779 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:00.759786 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:00.760280 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:00.760803 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:00.760817 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.761664 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.761667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:00.762598 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:00.762607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.763076 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.763079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:00.763224 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:00.763900 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:00.763922 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:00.765739 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:00.767767 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:00.767772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:00.767783 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:00.768045 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:00.768435 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:00.768439 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:00.768441 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:00.768586 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:00.769074 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:00.769083 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:00.769430 (+ 347us) client_negotiation.cc:769] Sending connection context
0810 01:41:00.769653 (+ 223us) client_negotiation.cc:240] Negotiation successful
0810 01:41:00.770039 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":112,"threads_started":1}
I20260810 01:41:00.772508 22687 heartbeater.cc:347] Connected to a master server at 127.24.205.190:37951
I20260810 01:41:00.772766 22687 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:00.773285 22687 heartbeater.cc:511] Master 127.24.205.190:37951 requested a full tablet report, sending...
I20260810 01:41:00.774539 22191 ts_manager.cc:194] Registered new tserver with Master: a2e16aaa7c6a434e9b9febc6db42b867 (127.24.205.130:42035)
I20260810 01:41:00.775413 22191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:41757
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:41:00.795146 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37951
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:00.909516 22692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:00.909804 22692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:00.909878 22692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:00.913913 22692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:00.913998 22692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:00.914096 22692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:41:00.919385 22692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:37951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:00.920490 22692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:00.921600 22692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:00.931699 22703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:00.931699 22700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:00.931699 22699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:00.932318 22692 server_base.cc:1034] running on GCE node
I20260810 01:41:00.932754 22692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:00.933436 22692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:00.934648 22692 hybrid_clock.cc:648] HybridClock initialized: now 1786326060934630 us; error 28 us; skew 500 ppm
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326060, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:00.937633 22692 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:41:00.938550 22692 webserver.cc:460] Webserver started at http://127.24.205.131:40873/ using document root <none> and password file <none>
I20260810 01:41:00.939147 22692 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:00.939244 22692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:00.939493 22692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:00.941691 22692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "97fff6b7c736415cbea2a2a7509e6318"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "248eead38b8332f502774d91a2d33d0f"
server_key_iv: "da086c58bcf0e12b6f095561d113e694"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.942324 22692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "97fff6b7c736415cbea2a2a7509e6318"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "248eead38b8332f502774d91a2d33d0f"
server_key_iv: "da086c58bcf0e12b6f095561d113e694"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.946322 22692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 01:41:00.948901 22716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.950179 22692 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:41:00.950332 22692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "97fff6b7c736415cbea2a2a7509e6318"
format_stamp: "Formatted at 2026-08-10 01:41:00 on dist-test-slave-t3q3"
server_key: "248eead38b8332f502774d91a2d33d0f"
server_key_iv: "da086c58bcf0e12b6f095561d113e694"
server_key_version: "encryptionkey@0"
I20260810 01:41:00.950451 22692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:00.971763 22692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:00.975126 22692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:00.975340 22692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:00.976018 22692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:00.976986 22692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:00.977064 22692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.977133 22692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:00.977186 22692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:00.986405 22692 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:44089
I20260810 01:41:00.986433 22885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:44089 every 8 connection(s)
I20260810 01:41:00.987349 22692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:41:00.992710 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 22692
I20260810 01:41:00.992878 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:41:00.993211 25398 external_mini_cluster.cc:1428] Setting key 0ea4c0f9a1a918df285d67bb88f91725
Aug 10 01:41:00 dist-test-slave-t3q3 krb5kdc[22116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326060, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:01.001343 22255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:00.989265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:38873 (local address 127.24.205.190:37951)
0810 01:41:00.989406 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:00.989410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:00.990299 (+ 889us) server_negotiation.cc:407] Connection header received
0810 01:41:00.991683 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:00.991687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:00.991748 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:00.991862 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:00.993245 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.993842 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.995433 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.995668 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.995750 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:00.998200 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:00.998203 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:00.998205 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:00.998229 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:00.999501 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:00.999968 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:00.999970 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:00.999972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:01.000046 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:01.000396 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:01.000399 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:01.000400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:01.000568 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:01.000645 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.001123 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.001222 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:41:01.002225 22896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:00.989641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:37951 (local address 127.24.205.131:38873)
0810 01:41:00.990148 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:00.990194 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:00.991463 (+ 1269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:00.992044 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:00.992051 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:00.992482 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:00.993097 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:00.993114 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.993997 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.994000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:00.995289 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:00.995302 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:00.995807 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:00.995810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:00.995965 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:00.996575 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:00.996592 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:00.998041 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:00.999608 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:00.999613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:00.999625 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:00.999881 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:01.000157 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:01.000169 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:01.000170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:01.000307 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:01.000656 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:01.000663 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:01.000894 (+ 231us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.001052 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.001322 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":120,"threads_started":1}
I20260810 01:41:01.003469 22886 heartbeater.cc:347] Connected to a master server at 127.24.205.190:37951
I20260810 01:41:01.003700 22886 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:01.004254 22886 heartbeater.cc:511] Master 127.24.205.190:37951 requested a full tablet report, sending...
I20260810 01:41:01.005267 22191 ts_manager.cc:194] Registered new tserver with Master: 97fff6b7c736415cbea2a2a7509e6318 (127.24.205.131:44089)
I20260810 01:41:01.005888 22191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:38873
I20260810 01:41:01.007457 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:41:01.017379 22255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.009665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51840 (local address 127.24.205.190:37951)
0810 01:41:01.009784 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.009788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.010007 (+ 219us) server_negotiation.cc:407] Connection header received
0810 01:41:01.010103 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.010105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.010141 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.010206 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:01.010952 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.011466 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.012364 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.012572 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.012652 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.014230 (+ 1578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:01.014233 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:01.014235 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:01.014256 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:01.015592 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:01.016134 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:01.016138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:01.016140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:01.016222 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:01.016516 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:01.016518 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:01.016519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:01.016713 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:01.016843 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.017181 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.017259 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:41:01.020795 22190 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:41:01.023980 22190 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:01.038609 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.032530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39320 (local address 127.24.205.129:42769)
0810 01:41:01.032817 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.032840 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.033597 (+ 757us) server_negotiation.cc:407] Connection header received
0810 01:41:01.033686 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.033691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.033929 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.034171 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:01.034512 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.035496 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.037110 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.037871 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.038010 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.038150 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.038343 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.038435 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
I20260810 01:41:01.038671 22916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.032828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:42035 (local address 127.0.0.1:55912)
0810 01:41:01.033228 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.033287 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:01.033425 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:01.034453 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:01.034459 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:01.034482 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:01.034571 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.034577 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.036014 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.036018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.037168 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.037176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.038214 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.038218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.038309 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.038335 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.038390 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.038462 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":30,"spinlock_wait_cycles":1920,"thread_start_us":94,"threads_started":1}
I20260810 01:41:01.038939 22917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.033151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:44089 (local address 127.0.0.1:47040)
0810 01:41:01.033668 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.033682 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:01.033770 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:01.034661 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:01.034664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:01.034685 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:01.034776 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.034783 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.036240 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.036244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.037449 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.037460 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.038584 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.038588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.038668 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.038705 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.038753 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.038814 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":40,"thread_start_us":100,"threads_started":1}
I20260810 01:41:01.038659 22913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.032399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:42769 (local address 127.0.0.1:39320)
0810 01:41:01.033229 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.033286 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:01.033425 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:01.034153 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:01.034158 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:01.034183 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:01.034345 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.034351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.035617 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.035624 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.036961 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.036973 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.037998 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.038001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.038126 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.038168 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.038298 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.038425 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"spinlock_wait_cycles":1408,"thread_start_us":65,"threads_started":1}
I20260810 01:41:01.039211 22918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.033107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55912 (local address 127.24.205.130:42035)
0810 01:41:01.034056 (+ 949us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.034067 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.034085 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:41:01.034147 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.034151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.034302 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.034458 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:01.034691 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.035869 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.037285 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.038066 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.038763 (+ 697us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.038908 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.038961 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.039071 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":844,"thread_start_us":141,"threads_started":1}
I20260810 01:41:01.040344 22919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.033589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47040 (local address 127.24.205.131:44089)
0810 01:41:01.034001 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.034012 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.034035 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:41:01.034113 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.034119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.034302 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.034457 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:01.034937 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.036040 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.037592 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.038435 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.039147 (+ 712us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.040024 (+ 877us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.040113 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.040211 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":139,"threads_started":1}
I20260810 01:41:01.042047 22586 tablet_service.cc:1467] Processing CreateTablet for tablet e89d15ad680346888c30a188153bef19 (DEFAULT_TABLE table=test-table [id=65fb1dbd11d2482c94c92214e2665e30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:01.042083 22395 tablet_service.cc:1467] Processing CreateTablet for tablet e89d15ad680346888c30a188153bef19 (DEFAULT_TABLE table=test-table [id=65fb1dbd11d2482c94c92214e2665e30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:01.043032 22586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89d15ad680346888c30a188153bef19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:01.043092 22395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89d15ad680346888c30a188153bef19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:01.042717 22797 tablet_service.cc:1467] Processing CreateTablet for tablet e89d15ad680346888c30a188153bef19 (DEFAULT_TABLE table=test-table [id=65fb1dbd11d2482c94c92214e2665e30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:01.043612 22797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89d15ad680346888c30a188153bef19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:01.049221 22920 tablet_bootstrap.cc:492] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Bootstrap starting.
I20260810 01:41:01.050864 22921 tablet_bootstrap.cc:492] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Bootstrap starting.
I20260810 01:41:01.051925 22920 tablet_bootstrap.cc:654] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:01.052352 22923 tablet_bootstrap.cc:492] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48: Bootstrap starting.
I20260810 01:41:01.052945 22921 tablet_bootstrap.cc:654] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:01.053166 22920 log.cc:824] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:01.054247 22921 log.cc:824] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:01.054585 22923 tablet_bootstrap.cc:654] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:01.055480 22923 log.cc:824] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:01.055846 22920 tablet_bootstrap.cc:492] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: No bootstrap required, opened a new log
I20260810 01:41:01.056047 22920 ts_tablet_manager.cc:1397] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 01:41:01.056298 22921 tablet_bootstrap.cc:492] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: No bootstrap required, opened a new log
I20260810 01:41:01.056526 22921 ts_tablet_manager.cc:1397] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:01.057346 22923 tablet_bootstrap.cc:492] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48: No bootstrap required, opened a new log
I20260810 01:41:01.057540 22923 ts_tablet_manager.cc:1397] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:41:01.060093 22920 raft_consensus.cc:348] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.060371 22920 raft_consensus.cc:374] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:01.060431 22920 raft_consensus.cc:729] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e16aaa7c6a434e9b9febc6db42b867, State: Initialized, Role: FOLLOWER
I20260810 01:41:01.060352 22921 raft_consensus.cc:348] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.060596 22921 raft_consensus.cc:374] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:01.060652 22921 raft_consensus.cc:729] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97fff6b7c736415cbea2a2a7509e6318, State: Initialized, Role: FOLLOWER
I20260810 01:41:01.060952 22920 consensus_queue.cc:260] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.060853 22923 raft_consensus.cc:348] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.061014 22921 consensus_queue.cc:260] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.061131 22923 raft_consensus.cc:374] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:01.061203 22923 raft_consensus.cc:729] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2f4a66bdcd246e1b6dea07564f4ee48, State: Initialized, Role: FOLLOWER
I20260810 01:41:01.061616 22923 consensus_queue.cc:260] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.061966 22920 ts_tablet_manager.cc:1428] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260810 01:41:01.061966 22921 ts_tablet_manager.cc:1428] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:41:01.062318 22687 heartbeater.cc:503] Master 127.24.205.190:37951 was elected leader, sending a full tablet report...
I20260810 01:41:01.062318 22886 heartbeater.cc:503] Master 127.24.205.190:37951 was elected leader, sending a full tablet report...
I20260810 01:41:01.062543 22923 ts_tablet_manager.cc:1428] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:41:01.063354 22488 heartbeater.cc:503] Master 127.24.205.190:37951 was elected leader, sending a full tablet report...
I20260810 01:41:01.127367 22929 raft_consensus.cc:482] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:01.127662 22929 raft_consensus.cc:504] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.129021 22929 leader_election.cc:288] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2f4a66bdcd246e1b6dea07564f4ee48 (127.24.205.129:42769), 97fff6b7c736415cbea2a2a7509e6318 (127.24.205.131:44089)
I20260810 01:41:01.132822 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.129397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:60443 (local address 127.24.205.129:42769)
0810 01:41:01.129545 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.129551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.129570 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:41:01.129628 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.129630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.129700 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.129780 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:01.130164 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.130678 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.131766 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.132246 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.132379 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.132435 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.132635 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.132710 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 01:41:01.132822 22689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.129241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:42769 (local address 127.24.205.130:60443)
0810 01:41:01.129386 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.129403 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:01.129490 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:01.129906 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:01.129909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:01.129929 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:01.130036 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.130042 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.130798 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.130803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.131632 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.131641 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.132379 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.132383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.132501 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.132520 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.132606 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.132685 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":6}
I20260810 01:41:01.133116 22919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.129753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:48937 (local address 127.24.205.131:44089)
0810 01:41:01.129876 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.129880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.130011 (+ 131us) server_negotiation.cc:407] Connection header received
0810 01:41:01.130184 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.130187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.130230 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.130316 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:01.130611 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.131092 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.132169 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.132557 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.132693 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.132741 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.132925 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.133003 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:41:01.133133 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.129495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:44089 (local address 127.24.205.130:48937)
0810 01:41:01.129907 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.129922 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:01.130047 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:01.130327 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:01.130330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:01.130346 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:01.130486 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.130492 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.131208 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.131213 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.131973 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.131981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.132687 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.132691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.132792 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.132821 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.132909 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.132992 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":171,"threads_started":1}
I20260810 01:41:01.133594 22422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89d15ad680346888c30a188153bef19" candidate_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" is_pre_election: true
I20260810 01:41:01.133724 22824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89d15ad680346888c30a188153bef19" candidate_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97fff6b7c736415cbea2a2a7509e6318" is_pre_election: true
I20260810 01:41:01.133929 22422 raft_consensus.cc:2454] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e16aaa7c6a434e9b9febc6db42b867 in term 0.
I20260810 01:41:01.134047 22824 raft_consensus.cc:2454] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2e16aaa7c6a434e9b9febc6db42b867 in term 0.
I20260810 01:41:01.134454 22524 leader_election.cc:302] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e16aaa7c6a434e9b9febc6db42b867, f2f4a66bdcd246e1b6dea07564f4ee48; no voters:
I20260810 01:41:01.134687 22929 raft_consensus.cc:2781] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:01.134764 22929 raft_consensus.cc:482] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:01.134795 22929 raft_consensus.cc:3037] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:01.135851 22929 raft_consensus.cc:504] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.136214 22929 leader_election.cc:288] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [CANDIDATE]: Term 1 election: Requested vote from peers f2f4a66bdcd246e1b6dea07564f4ee48 (127.24.205.129:42769), 97fff6b7c736415cbea2a2a7509e6318 (127.24.205.131:44089)
I20260810 01:41:01.136579 22422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89d15ad680346888c30a188153bef19" candidate_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48"
I20260810 01:41:01.136620 22824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89d15ad680346888c30a188153bef19" candidate_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97fff6b7c736415cbea2a2a7509e6318"
I20260810 01:41:01.136691 22422 raft_consensus.cc:3037] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:01.136766 22824 raft_consensus.cc:3037] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:01.137804 22422 raft_consensus.cc:2454] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e16aaa7c6a434e9b9febc6db42b867 in term 1.
I20260810 01:41:01.137821 22824 raft_consensus.cc:2454] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2e16aaa7c6a434e9b9febc6db42b867 in term 1.
I20260810 01:41:01.138103 22524 leader_election.cc:302] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2e16aaa7c6a434e9b9febc6db42b867, f2f4a66bdcd246e1b6dea07564f4ee48; no voters:
I20260810 01:41:01.138293 22929 raft_consensus.cc:2781] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:01.138522 22929 raft_consensus.cc:686] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 1 LEADER]: Becoming Leader. State: Replica: a2e16aaa7c6a434e9b9febc6db42b867, State: Running, Role: LEADER
I20260810 01:41:01.138957 22929 consensus_queue.cc:237] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } }
I20260810 01:41:01.142505 22191 catalog_manager.cc:5495] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2e16aaa7c6a434e9b9febc6db42b867 (127.24.205.130). New cstate: current_term: 1 leader_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2e16aaa7c6a434e9b9febc6db42b867" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42035 } health_report { overall_health: HEALTHY } } }
I20260810 01:41:01.162513 22918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.158712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55924 (local address 127.24.205.130:42035)
0810 01:41:01.158873 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.158877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.158894 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:41:01.159008 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.159011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.159067 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.159186 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:01.159445 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.159972 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.160903 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.161132 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.161250 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.161580 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:01.161999 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:01.162169 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.162310 (+ 141us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.162351 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 01:41:01.168644 22824 raft_consensus.cc:1261] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 1 FOLLOWER]: Refusing update from remote peer a2e16aaa7c6a434e9b9febc6db42b867: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:01.168646 22422 raft_consensus.cc:1261] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48 [term 1 FOLLOWER]: Refusing update from remote peer a2e16aaa7c6a434e9b9febc6db42b867: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:01.169426 22936 consensus_queue.cc:1035] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2f4a66bdcd246e1b6dea07564f4ee48" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:01.169634 22929 consensus_queue.cc:1035] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97fff6b7c736415cbea2a2a7509e6318" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:01.177239 22942 mvcc.cc:205] Tried to move back new op lower bound from 7316791546538446848 to 7316791546428407808. Current Snapshot: MvccSnapshot[applied={T|T < 7316791546538446848}]
I20260810 01:41:01.186026 22190 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:01.186228 22190 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:01.188900 22190 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 81dd0cacadeb47dc963799924295475b: Sending DeleteTablet for 3 replicas of tablet e89d15ad680346888c30a188153bef19
I20260810 01:41:01.189836 22586 tablet_service.cc:1514] Processing DeleteTablet for tablet e89d15ad680346888c30a188153bef19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:01 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:55912
I20260810 01:41:01.189843 22395 tablet_service.cc:1514] Processing DeleteTablet for tablet e89d15ad680346888c30a188153bef19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:01 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:39320
I20260810 01:41:01.189980 22797 tablet_service.cc:1514] Processing DeleteTablet for tablet e89d15ad680346888c30a188153bef19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:01 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:47040
I20260810 01:41:01.190440 22954 tablet_replica.cc:330] T e89d15ad680346888c30a188153bef19 P f2f4a66bdcd246e1b6dea07564f4ee48: stopping tablet replica
I20260810 01:41:01.190690 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 22292
I20260810 01:41:01.200279 22952 tablet_replica.cc:330] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: stopping tablet replica
I20260810 01:41:01.200651 22952 raft_consensus.cc:2229] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:41:01.201123 22952 raft_consensus.cc:2258] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:01.204432 22955 tablet_replica.cc:330] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: stopping tablet replica
I20260810 01:41:01.204859 22955 raft_consensus.cc:2229] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:01.205308 22955 raft_consensus.cc:2258] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:01.206580 22952 ts_tablet_manager.cc:1905] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:01.206809 22955 ts_tablet_manager.cc:1905] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:01.209715 22952 ts_tablet_manager.cc:1918] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:01.209714 22955 ts_tablet_manager.cc:1918] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:01.209830 22952 log.cc:1196] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/e89d15ad680346888c30a188153bef19
I20260810 01:41:01.209972 22955 log.cc:1196] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/e89d15ad680346888c30a188153bef19
I20260810 01:41:01.210214 22952 ts_tablet_manager.cc:1939] T e89d15ad680346888c30a188153bef19 P a2e16aaa7c6a434e9b9febc6db42b867: Deleting consensus metadata
W20260810 01:41:01.210180 22164 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:42769 (error 108)
I20260810 01:41:01.210476 22955 ts_tablet_manager.cc:1939] T e89d15ad680346888c30a188153bef19 P 97fff6b7c736415cbea2a2a7509e6318: Deleting consensus metadata
I20260810 01:41:01.211094 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 22496
I20260810 01:41:01.211767 22164 catalog_manager.cc:4841] TS 97fff6b7c736415cbea2a2a7509e6318 (127.24.205.131:44089): tablet e89d15ad680346888c30a188153bef19 (table test-table [id=65fb1dbd11d2482c94c92214e2665e30]) successfully deleted
I20260810 01:41:01.214623 22913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.214031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:42769 (local address 127.0.0.1:39334)
0810 01:41:01.214424 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.214518 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:42769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266}
W20260810 01:41:01.216919 22164 catalog_manager.cc:4584] TS f2f4a66bdcd246e1b6dea07564f4ee48 (127.24.205.129:42769): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e89d15ad680346888c30a188153bef19: Network error: Client connection negotiation failed: client connection to 127.24.205.129:42769: connect: Connection refused (error 111)
I20260810 01:41:01.222869 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 22692
I20260810 01:41:01.226136 22913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.222942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:42035 (local address 127.0.0.1:55934)
0810 01:41:01.225916 (+ 2974us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.226005 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.130:42035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2856}
I20260810 01:41:01.233556 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 22136
2026-08-10T01:41:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2649 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T01:41:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:01Z Disabled control of system clock
I20260810 01:41:01.277837 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43761
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:43761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:41:01.391549 22961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:01.391798 22961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:01.391834 22961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:01.395807 22961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:01.395864 22961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:01.395880 22961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:01.395896 22961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:01.395912 22961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:01.400951 22961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:43761
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:01.401940 22961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:01.403399 22961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:01.411706 22969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:01.411721 22970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:01.411870 22961 server_base.cc:1034] running on GCE node
W20260810 01:41:01.412075 22973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:01.412667 22961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:01.413729 22961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:01.414948 22961 hybrid_clock.cc:648] HybridClock initialized: now 1786326061414928 us; error 32 us; skew 500 ppm
I20260810 01:41:01.416851 22961 webserver.cc:460] Webserver started at http://127.24.205.190:34087/ using document root <none> and password file <none>
I20260810 01:41:01.417435 22961 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:01.417526 22961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:01.417761 22961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:01.419797 22961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "615ffb81030859f9a0075b9c10665d6a"
server_key_iv: "81841685a7c132cf312c21b3127ccd2c"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.420400 22961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "615ffb81030859f9a0075b9c10665d6a"
server_key_iv: "81841685a7c132cf312c21b3127ccd2c"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.423902 22961 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:41:01.426283 22983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:01.427464 22961 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:01.427613 22961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "615ffb81030859f9a0075b9c10665d6a"
server_key_iv: "81841685a7c132cf312c21b3127ccd2c"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.427719 22961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:01.438325 22961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:01.438923 22961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:01.439105 22961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:01.445874 22961 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:43761
I20260810 01:41:01.445915 23064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:43761 every 8 connection(s)
I20260810 01:41:01.446800 22961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:01.449985 23066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:01.454197 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 22961
I20260810 01:41:01.454324 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:01.454644 25398 external_mini_cluster.cc:1428] Setting key 4b75d1ab292273d38a2d71b63a4c7740
I20260810 01:41:01.455904 23066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e: Bootstrap starting.
I20260810 01:41:01.458160 23066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:01.458899 23066 log.cc:824] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:01.460788 23066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e: No bootstrap required, opened a new log
I20260810 01:41:01.463986 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.456182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55156 (local address 127.24.205.190:43761)
0810 01:41:01.456803 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.456819 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.456853 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:41:01.457525 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.457541 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.457917 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.458257 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:01.458694 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.459703 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.460687 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.461215 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.461400 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.462305 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:01.462310 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:01.462322 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:01.462692 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:01.462745 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:01.462772 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:01.462878 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.463041 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.463291 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":131,"threads_started":1}
I20260810 01:41:01.464635 23066 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43761 } }
I20260810 01:41:01.464898 23066 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:01.464959 23066 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf21297cf4a64dc7a4f6c783ad8d2c8e, State: Initialized, Role: FOLLOWER
I20260810 01:41:01.465384 23066 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43761 } }
I20260810 01:41:01.465516 23066 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:01.465585 23066 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:01.465713 23066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:01.466735 23066 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43761 } }
I20260810 01:41:01.467073 23066 leader_election.cc:302] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf21297cf4a64dc7a4f6c783ad8d2c8e; no voters:
I20260810 01:41:01.467381 23066 leader_election.cc:288] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:01.467536 23074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:01.467770 23074 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [term 1 LEADER]: Becoming Leader. State: Replica: cf21297cf4a64dc7a4f6c783ad8d2c8e, State: Running, Role: LEADER
I20260810 01:41:01.468116 23074 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43761 } }
I20260810 01:41:01.468712 23066 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:01.469241 23077 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf21297cf4a64dc7a4f6c783ad8d2c8e. Latest consensus state: current_term: 1 leader_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43761 } } }
I20260810 01:41:01.469378 23077 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:01.469686 23076 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf21297cf4a64dc7a4f6c783ad8d2c8e" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43761 } } }
I20260810 01:41:01.469798 23076 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:01.471239 23082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:01.474128 23082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:01.479640 23082 catalog_manager.cc:1347] Generated new cluster ID: 2d5861dc2c0245a28c9a2d60997c84f3
I20260810 01:41:01.479704 23082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:01.498711 23082 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:01.499948 23082 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:01.511231 23082 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e: Generated new TSK 0
I20260810 01:41:01.512156 23082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:01.521652 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43761
--builtin_ntp_servers=127.24.205.148:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:41:01.640183 23103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:01.640434 23103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:01.640470 23103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:01.644383 23103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:01.644429 23103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:01.644480 23103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:41:01.649205 23103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:01.650218 23103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:01.651500 23103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:01.661092 23118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:01.661116 23113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:01.661167 23103 server_base.cc:1034] running on GCE node
W20260810 01:41:01.661092 23112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:01.661723 23103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:01.662369 23103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:01.663564 23103 hybrid_clock.cc:648] HybridClock initialized: now 1786326061663548 us; error 29 us; skew 500 ppm
I20260810 01:41:01.665493 23103 webserver.cc:460] Webserver started at http://127.24.205.129:39737/ using document root <none> and password file <none>
I20260810 01:41:01.666082 23103 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:01.666177 23103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:01.666431 23103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:01.668635 23103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "f530ac0966dc406c9f2092a0574ba25c"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "8f2d4b2f3b9206851922cb4964ebc96b"
server_key_iv: "5627b7f19da9a75afdb33d6ec3a35ce6"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.669242 23103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "f530ac0966dc406c9f2092a0574ba25c"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "8f2d4b2f3b9206851922cb4964ebc96b"
server_key_iv: "5627b7f19da9a75afdb33d6ec3a35ce6"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.674019 23103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:41:01.677209 23125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:01.678540 23103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:41:01.678692 23103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "f530ac0966dc406c9f2092a0574ba25c"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "8f2d4b2f3b9206851922cb4964ebc96b"
server_key_iv: "5627b7f19da9a75afdb33d6ec3a35ce6"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.678834 23103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:01.696933 23103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:01.697621 23103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:01.697825 23103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:01.698438 23103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:01.699406 23103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:01.699482 23103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:01.699558 23103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:01.699602 23103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:01.708856 23103 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:46653
I20260810 01:41:01.708927 23284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:46653 every 8 connection(s)
I20260810 01:41:01.709860 23103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:01.719296 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.711784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:35555 (local address 127.24.205.190:43761)
0810 01:41:01.711920 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.711923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.713105 (+ 1182us) server_negotiation.cc:407] Connection header received
0810 01:41:01.714529 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.714533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.714592 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.714702 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:01.715605 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.716225 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.717364 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.717596 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.717713 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.718778 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:01.718787 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:01.718789 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:01.718801 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:01.718819 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:01.718827 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:01.718905 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.719072 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.719130 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:41:01.719512 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 23103
I20260810 01:41:01.719661 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:01.719966 25398 external_mini_cluster.cc:1428] Setting key a507610511b82caf3308e1634ec1e341
I20260810 01:41:01.720321 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.712241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43761 (local address 127.24.205.129:35555)
0810 01:41:01.712918 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.712957 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:01.714308 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:01.714895 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:01.714902 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:01.714984 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:01.715459 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.715471 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.716363 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.716365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.717235 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.717245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.717757 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.717761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.717924 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.718505 (+ 581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:41:01.718507 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:01.718546 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:41:01.718623 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:01.718907 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:01.718919 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:01.718927 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.719050 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.719319 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":135,"threads_started":1}
I20260810 01:41:01.721645 23287 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43761
I20260810 01:41:01.721875 23287 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:01.722221 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43761
--builtin_ntp_servers=127.24.205.148:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:41:01.722405 23287 heartbeater.cc:511] Master 127.24.205.190:43761 requested a full tablet report, sending...
I20260810 01:41:01.723943 23010 ts_manager.cc:194] Registered new tserver with Master: f530ac0966dc406c9f2092a0574ba25c (127.24.205.129:46653)
I20260810 01:41:01.725606 23010 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.129:35555
W20260810 01:41:01.837914 23290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:01.838171 23290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:01.838209 23290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:01.842167 23290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:01.842223 23290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:01.842303 23290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:41:01.846944 23290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:01.848143 23290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:01.849610 23290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:01.859299 23305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:01.859309 23299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:01.859355 23301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:01.859683 23290 server_base.cc:1034] running on GCE node
I20260810 01:41:01.860167 23290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:01.860860 23290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:01.862048 23290 hybrid_clock.cc:648] HybridClock initialized: now 1786326061862018 us; error 53 us; skew 500 ppm
I20260810 01:41:01.863868 23290 webserver.cc:460] Webserver started at http://127.24.205.130:45207/ using document root <none> and password file <none>
I20260810 01:41:01.864567 23290 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:01.864665 23290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:01.864892 23290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:01.867059 23290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "046e3b2794e14baab2cffc6bd2baa81d"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "ad546bcfab404839b4a057171ff3cc3d"
server_key_iv: "9a016a84c7f011109ed503d673c9ad33"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.867686 23290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "046e3b2794e14baab2cffc6bd2baa81d"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "ad546bcfab404839b4a057171ff3cc3d"
server_key_iv: "9a016a84c7f011109ed503d673c9ad33"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.872177 23290 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260810 01:41:01.874737 23314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:01.875985 23290 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:01.876154 23290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "046e3b2794e14baab2cffc6bd2baa81d"
format_stamp: "Formatted at 2026-08-10 01:41:01 on dist-test-slave-t3q3"
server_key: "ad546bcfab404839b4a057171ff3cc3d"
server_key_iv: "9a016a84c7f011109ed503d673c9ad33"
server_key_version: "encryptionkey@0"
I20260810 01:41:01.876297 23290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:01.887424 23290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:01.888213 23290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:01.888414 23290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:01.889031 23290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:01.890028 23290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:01.890103 23290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:01.890187 23290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:01.890233 23290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:01.899613 23290 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:41653
I20260810 01:41:01.899636 23483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:41653 every 8 connection(s)
I20260810 01:41:01.900614 23290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:41:01.901047 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 23290
I20260810 01:41:01.901168 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:41:01.901525 25398 external_mini_cluster.cc:1428] Setting key 877e41e5816a62139e8a7d3d35d9e617
I20260810 01:41:01.903826 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43761
--builtin_ntp_servers=127.24.205.148:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:41:01.911356 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.902677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:44773 (local address 127.24.205.190:43761)
0810 01:41:01.902804 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:01.902808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:01.904317 (+ 1509us) server_negotiation.cc:407] Connection header received
0810 01:41:01.906355 (+ 2038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:01.906359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:01.906414 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:01.906520 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:01.907438 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.907974 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.909259 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.909482 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.909594 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.910833 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:01.910841 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:01.910843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:01.910856 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:01.910876 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:01.910884 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:01.910970 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:01.911143 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 01:41:01.911210 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:41:01.912297 23486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:01.903272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43761 (local address 127.24.205.130:44773)
0810 01:41:01.904135 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:01.904192 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:01.906133 (+ 1941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:01.906707 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:01.906715 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:01.906803 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:01.907293 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.907305 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.908130 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.908136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.909129 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:01.909138 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:01.909638 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:01.909642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:01.909819 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:01.910529 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:41:01.910530 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:01.910585 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:41:01.910653 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:01.910972 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:01.910984 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:01.910993 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 01:41:01.911131 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 01:41:01.911418 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":103,"threads_started":1}
I20260810 01:41:01.913508 23484 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43761
I20260810 01:41:01.913761 23484 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:01.914294 23484 heartbeater.cc:511] Master 127.24.205.190:43761 requested a full tablet report, sending...
I20260810 01:41:01.915407 23010 ts_manager.cc:194] Registered new tserver with Master: 046e3b2794e14baab2cffc6bd2baa81d (127.24.205.130:41653)
I20260810 01:41:01.916280 23010 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.130:44773
W20260810 01:41:02.023872 23487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:02.024227 23487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:02.024276 23487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:02.028362 23487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:02.028432 23487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:02.028491 23487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:41:02.033488 23487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:43761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:02.034590 23487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:02.035982 23487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:02.045990 23496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:02.046103 23500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:02.045990 23498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:02.046387 23487 server_base.cc:1034] running on GCE node
I20260810 01:41:02.046877 23487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:02.047536 23487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:02.048702 23487 hybrid_clock.cc:648] HybridClock initialized: now 1786326062048686 us; error 29 us; skew 500 ppm
I20260810 01:41:02.050915 23487 webserver.cc:460] Webserver started at http://127.24.205.131:33671/ using document root <none> and password file <none>
I20260810 01:41:02.051532 23487 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:02.051600 23487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:02.051826 23487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:02.054075 23487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9"
format_stamp: "Formatted at 2026-08-10 01:41:02 on dist-test-slave-t3q3"
server_key: "7edf02b16e17f3b4608e7135ea386e78"
server_key_iv: "2ec964c49a9055c2a28af233b6d843d2"
server_key_version: "encryptionkey@0"
I20260810 01:41:02.054684 23487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9"
format_stamp: "Formatted at 2026-08-10 01:41:02 on dist-test-slave-t3q3"
server_key: "7edf02b16e17f3b4608e7135ea386e78"
server_key_iv: "2ec964c49a9055c2a28af233b6d843d2"
server_key_version: "encryptionkey@0"
I20260810 01:41:02.058861 23487 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:41:02.061834 23508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:02.063241 23487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:41:02.063395 23487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9"
format_stamp: "Formatted at 2026-08-10 01:41:02 on dist-test-slave-t3q3"
server_key: "7edf02b16e17f3b4608e7135ea386e78"
server_key_iv: "2ec964c49a9055c2a28af233b6d843d2"
server_key_version: "encryptionkey@0"
I20260810 01:41:02.063519 23487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:02.095870 23487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:02.096684 23487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:02.096904 23487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:02.097568 23487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:02.098584 23487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:02.098632 23487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:02.098698 23487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:02.098731 23487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:02.108282 23487 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:44873
I20260810 01:41:02.108310 23670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:44873 every 8 connection(s)
I20260810 01:41:02.109272 23487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:41:02.111846 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 23487
I20260810 01:41:02.111972 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:41:02.112345 25398 external_mini_cluster.cc:1428] Setting key 54f5289b443dd99e4aa45b1fc0124452
I20260810 01:41:02.118959 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.111213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:43055 (local address 127.24.205.190:43761)
0810 01:41:02.111373 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.111377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.112567 (+ 1190us) server_negotiation.cc:407] Connection header received
0810 01:41:02.114264 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.114268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.114326 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.114426 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:02.115413 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.115995 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.117185 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.117432 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.117517 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.118544 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:02.118547 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:02.118550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:02.118562 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:02.118581 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:02.118589 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:02.118653 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.118792 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.118844 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 01:41:02.119772 23677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.111635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:43761 (local address 127.24.205.131:43055)
0810 01:41:02.112385 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:02.112437 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:02.114052 (+ 1615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:02.114584 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:02.114591 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:02.114676 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:02.115274 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.115288 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.116181 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.116183 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.117074 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.117082 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.117568 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.117571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.117720 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.118302 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:41:02.118304 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:02.118343 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:41:02.118402 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:02.118667 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:02.118673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:02.118677 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:41:02.118769 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 01:41:02.118972 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":129,"threads_started":1}
I20260810 01:41:02.120958 23671 heartbeater.cc:347] Connected to a master server at 127.24.205.190:43761
I20260810 01:41:02.121155 23671 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:02.121618 23671 heartbeater.cc:511] Master 127.24.205.190:43761 requested a full tablet report, sending...
I20260810 01:41:02.122596 23010 ts_manager.cc:194] Registered new tserver with Master: a92b73c5d0d245bb8fd5eccdc1e156a9 (127.24.205.131:44873)
I20260810 01:41:02.123231 23010 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.131:43055
I20260810 01:41:02.126652 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:41:02.133132 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.128717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55158 (local address 127.24.205.190:43761)
0810 01:41:02.128874 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.128878 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.129046 (+ 168us) server_negotiation.cc:407] Connection header received
0810 01:41:02.129224 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.129228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.129278 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.129370 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:02.129687 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.130227 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.131239 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.131479 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.131600 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.132567 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:02.132571 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:02.132573 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:02.132585 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:02.132603 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:02.132611 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:02.132754 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.132934 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.132990 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:41:02.135950 23010 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:41:02.139151 23010 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:02.153592 23688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.147654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:41653 (local address 127.0.0.1:37720)
0810 01:41:02.147978 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:02.148024 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:02.148179 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:02.149038 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:02.149046 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:02.149065 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:02.149196 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.149202 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.150532 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.150536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.151899 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.151908 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.153051 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.153055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.153164 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.153201 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 01:41:02.153313 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 01:41:02.153427 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":90,"threads_started":1}
I20260810 01:41:02.153592 23690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.147808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37720 (local address 127.24.205.130:41653)
0810 01:41:02.148316 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.148334 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.148360 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:41:02.148441 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.148445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.148664 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.148840 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:02.149319 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.150389 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.152022 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.152895 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.153053 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.153242 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.153346 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.153435 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":150,"threads_started":1}
I20260810 01:41:02.154284 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.147869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:44873 (local address 127.0.0.1:40066)
0810 01:41:02.148866 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:02.148881 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:02.148965 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:02.150030 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:02.150032 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:02.150050 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:02.150167 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.150173 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.151406 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.151412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.152543 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.152554 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.153871 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.153875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.153964 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.153990 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:41:02.154072 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 01:41:02.154155 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"thread_start_us":96,"threads_started":1}
I20260810 01:41:02.154671 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.148617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38318 (local address 127.24.205.129:46653)
0810 01:41:02.149850 (+ 1233us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.149861 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.149883 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:41:02.149956 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.149960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.150148 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.150300 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:02.150532 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.151697 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.153248 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.154019 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.154183 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.154351 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.154410 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.154514 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1110,"thread_start_us":99,"threads_started":1}
I20260810 01:41:02.154836 23696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.148897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40066 (local address 127.24.205.131:44873)
0810 01:41:02.149247 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.149259 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.149282 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:41:02.149535 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.149543 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.149737 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.149880 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:02.150554 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.151281 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.152698 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.153505 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.153617 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.153799 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.154570 (+ 771us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.154683 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":166,"threads_started":1}
I20260810 01:41:02.154876 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.148446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:46653 (local address 127.0.0.1:38318)
0810 01:41:02.149480 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:02.149495 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:02.149585 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:02.150294 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:02.150297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:02.150316 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:02.150408 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.150416 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.151818 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.151821 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.153091 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.153101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.154160 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.154164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.154261 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.154287 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:41:02.154532 (+ 245us) client_negotiation.cc:240] Negotiation successful
0810 01:41:02.154614 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":938,"thread_start_us":138,"threads_started":1}
I20260810 01:41:02.157255 23383 tablet_service.cc:1467] Processing CreateTablet for tablet 52da2d577ff8409597b69a4586f3e991 (DEFAULT_TABLE table=test-table [id=92665f0a541c49b286fb8a9da04fdd5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:02.157371 23576 tablet_service.cc:1467] Processing CreateTablet for tablet 52da2d577ff8409597b69a4586f3e991 (DEFAULT_TABLE table=test-table [id=92665f0a541c49b286fb8a9da04fdd5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:02.158196 23383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52da2d577ff8409597b69a4586f3e991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:02.158422 23576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52da2d577ff8409597b69a4586f3e991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:02.158778 23191 tablet_service.cc:1467] Processing CreateTablet for tablet 52da2d577ff8409597b69a4586f3e991 (DEFAULT_TABLE table=test-table [id=92665f0a541c49b286fb8a9da04fdd5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:02.159796 23191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52da2d577ff8409597b69a4586f3e991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:02.165367 23697 tablet_bootstrap.cc:492] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Bootstrap starting.
I20260810 01:41:02.166139 23699 tablet_bootstrap.cc:492] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Bootstrap starting.
I20260810 01:41:02.166877 23701 tablet_bootstrap.cc:492] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: Bootstrap starting.
I20260810 01:41:02.167905 23697 tablet_bootstrap.cc:654] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:02.168618 23699 tablet_bootstrap.cc:654] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:02.169093 23697 log.cc:824] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:02.169428 23699 log.cc:824] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:02.169495 23701 tablet_bootstrap.cc:654] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:02.170331 23701 log.cc:824] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:02.171612 23699 tablet_bootstrap.cc:492] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: No bootstrap required, opened a new log
I20260810 01:41:02.171741 23697 tablet_bootstrap.cc:492] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: No bootstrap required, opened a new log
I20260810 01:41:02.171856 23699 ts_tablet_manager.cc:1397] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:41:02.171939 23697 ts_tablet_manager.cc:1397] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260810 01:41:02.172412 23701 tablet_bootstrap.cc:492] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: No bootstrap required, opened a new log
I20260810 01:41:02.172612 23701 ts_tablet_manager.cc:1397] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260810 01:41:02.175308 23699 raft_consensus.cc:348] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.175575 23699 raft_consensus.cc:374] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:02.175630 23699 raft_consensus.cc:729] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92b73c5d0d245bb8fd5eccdc1e156a9, State: Initialized, Role: FOLLOWER
I20260810 01:41:02.176180 23699 consensus_queue.cc:260] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.176388 23697 raft_consensus.cc:348] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.176652 23697 raft_consensus.cc:374] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:02.176713 23697 raft_consensus.cc:729] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046e3b2794e14baab2cffc6bd2baa81d, State: Initialized, Role: FOLLOWER
I20260810 01:41:02.176753 23701 raft_consensus.cc:348] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.176998 23701 raft_consensus.cc:374] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:02.177049 23671 heartbeater.cc:503] Master 127.24.205.190:43761 was elected leader, sending a full tablet report...
I20260810 01:41:02.177060 23701 raft_consensus.cc:729] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f530ac0966dc406c9f2092a0574ba25c, State: Initialized, Role: FOLLOWER
I20260810 01:41:02.177438 23699 ts_tablet_manager.cc:1428] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:41:02.177493 23701 consensus_queue.cc:260] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.178105 23287 heartbeater.cc:503] Master 127.24.205.190:43761 was elected leader, sending a full tablet report...
I20260810 01:41:02.178297 23697 consensus_queue.cc:260] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.178522 23701 ts_tablet_manager.cc:1428] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:41:02.179016 23484 heartbeater.cc:503] Master 127.24.205.190:43761 was elected leader, sending a full tablet report...
I20260810 01:41:02.179302 23697 ts_tablet_manager.cc:1428] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260810 01:41:02.205453 23707 raft_consensus.cc:482] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:02.205667 23707 raft_consensus.cc:504] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.206777 23707 leader_election.cc:288] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046e3b2794e14baab2cffc6bd2baa81d (127.24.205.130:41653), f530ac0966dc406c9f2092a0574ba25c (127.24.205.129:46653)
I20260810 01:41:02.210585 23690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.207178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:54691 (local address 127.24.205.130:41653)
0810 01:41:02.207302 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.207305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.207342 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:41:02.207409 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.207415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.207475 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.207589 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:02.207885 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.208422 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.209648 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.210034 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.210171 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.210223 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.210392 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.210459 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:41:02.210582 23677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.207045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:41653 (local address 127.24.205.131:54691)
0810 01:41:02.207193 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:02.207210 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:02.207318 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:02.207604 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:02.207607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:02.207627 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:02.207761 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.207768 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.208539 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.208544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.209523 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.209533 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.210162 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.210166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.210263 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.210289 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:41:02.210376 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 01:41:02.210446 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 01:41:02.210999 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.207534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:40241 (local address 127.24.205.129:46653)
0810 01:41:02.207680 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.207685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.207856 (+ 171us) server_negotiation.cc:407] Connection header received
0810 01:41:02.208014 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.208016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.208103 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.208196 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:02.208476 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.208974 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.209982 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.210363 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.210493 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.210540 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.210784 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.210858 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260810 01:41:02.211154 23288 tablet.cc:2369] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:41:02.211402 23712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.207381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:46653 (local address 127.24.205.131:40241)
0810 01:41:02.207757 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:02.207767 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:02.207884 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:02.208208 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:02.208210 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:02.208226 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:02.208358 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.208363 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.209088 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.209092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.209848 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:02.209856 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.210495 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.210499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:02.210597 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.210622 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:41:02.211185 (+ 563us) client_negotiation.cc:240] Negotiation successful
0810 01:41:02.211282 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":135,"threads_started":1}
I20260810 01:41:02.212035 23410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52da2d577ff8409597b69a4586f3e991" candidate_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046e3b2794e14baab2cffc6bd2baa81d" is_pre_election: true
I20260810 01:41:02.212033 23221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52da2d577ff8409597b69a4586f3e991" candidate_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530ac0966dc406c9f2092a0574ba25c" is_pre_election: true
I20260810 01:41:02.212385 23410 raft_consensus.cc:2454] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92b73c5d0d245bb8fd5eccdc1e156a9 in term 0.
I20260810 01:41:02.212385 23221 raft_consensus.cc:2454] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92b73c5d0d245bb8fd5eccdc1e156a9 in term 0.
I20260810 01:41:02.212903 23510 leader_election.cc:302] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046e3b2794e14baab2cffc6bd2baa81d, a92b73c5d0d245bb8fd5eccdc1e156a9; no voters:
I20260810 01:41:02.213191 23707 raft_consensus.cc:2781] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:02.213296 23707 raft_consensus.cc:482] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:02.213361 23707 raft_consensus.cc:3037] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:02.214380 23707 raft_consensus.cc:504] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.214771 23707 leader_election.cc:288] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [CANDIDATE]: Term 1 election: Requested vote from peers 046e3b2794e14baab2cffc6bd2baa81d (127.24.205.130:41653), f530ac0966dc406c9f2092a0574ba25c (127.24.205.129:46653)
I20260810 01:41:02.215178 23410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52da2d577ff8409597b69a4586f3e991" candidate_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046e3b2794e14baab2cffc6bd2baa81d"
I20260810 01:41:02.215178 23221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52da2d577ff8409597b69a4586f3e991" candidate_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f530ac0966dc406c9f2092a0574ba25c"
I20260810 01:41:02.215325 23410 raft_consensus.cc:3037] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:02.215328 23221 raft_consensus.cc:3037] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:02.216440 23410 raft_consensus.cc:2454] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92b73c5d0d245bb8fd5eccdc1e156a9 in term 1.
I20260810 01:41:02.216440 23221 raft_consensus.cc:2454] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92b73c5d0d245bb8fd5eccdc1e156a9 in term 1.
I20260810 01:41:02.216761 23510 leader_election.cc:302] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046e3b2794e14baab2cffc6bd2baa81d, a92b73c5d0d245bb8fd5eccdc1e156a9; no voters:
I20260810 01:41:02.216970 23707 raft_consensus.cc:2781] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:02.217235 23707 raft_consensus.cc:686] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 1 LEADER]: Becoming Leader. State: Replica: a92b73c5d0d245bb8fd5eccdc1e156a9, State: Running, Role: LEADER
I20260810 01:41:02.217572 23707 consensus_queue.cc:237] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } }
I20260810 01:41:02.220881 23009 catalog_manager.cc:5495] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92b73c5d0d245bb8fd5eccdc1e156a9 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92b73c5d0d245bb8fd5eccdc1e156a9" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 44873 } health_report { overall_health: HEALTHY } } }
I20260810 01:41:02.239482 23696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.236126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40068 (local address 127.24.205.131:44873)
0810 01:41:02.236266 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:02.236270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:02.236284 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:41:02.236396 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:02.236398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:02.236453 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:02.236543 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:02.236765 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.237257 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.238086 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:02.238305 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:02.238387 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:02.238637 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:02.239046 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:02.239159 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:02.239237 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 01:41:02.239267 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:41:02.245460 23221 raft_consensus.cc:1261] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c [term 1 FOLLOWER]: Refusing update from remote peer a92b73c5d0d245bb8fd5eccdc1e156a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:02.245473 23410 raft_consensus.cc:1261] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 1 FOLLOWER]: Refusing update from remote peer a92b73c5d0d245bb8fd5eccdc1e156a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:02.246191 23707 consensus_queue.cc:1035] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046e3b2794e14baab2cffc6bd2baa81d" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:02.246472 23713 consensus_queue.cc:1035] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f530ac0966dc406c9f2092a0574ba25c" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 46653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:02.255844 23724 mvcc.cc:205] Tried to move back new op lower bound from 7316791550950027264 to 7316791550846046208. Current Snapshot: MvccSnapshot[applied={T|T < 7316791550950027264}]
I20260810 01:41:02.256219 23719 mvcc.cc:205] Tried to move back new op lower bound from 7316791550950027264 to 7316791550846046208. Current Snapshot: MvccSnapshot[applied={T|T < 7316791550950027264}]
I20260810 01:41:02.256867 23717 mvcc.cc:205] Tried to move back new op lower bound from 7316791550950027264 to 7316791550846046208. Current Snapshot: MvccSnapshot[applied={T|T < 7316791550950027264 or (T in {7316791550950027264})}]
I20260810 01:41:02.263165 23009 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:02.263350 23009 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:02.265861 23009 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf21297cf4a64dc7a4f6c783ad8d2c8e: Sending DeleteTablet for 3 replicas of tablet 52da2d577ff8409597b69a4586f3e991
I20260810 01:41:02.266709 23191 tablet_service.cc:1514] Processing DeleteTablet for tablet 52da2d577ff8409597b69a4586f3e991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:02 UTC) from {username='slave'} at 127.0.0.1:38318
I20260810 01:41:02.266709 23576 tablet_service.cc:1514] Processing DeleteTablet for tablet 52da2d577ff8409597b69a4586f3e991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:02 UTC) from {username='slave'} at 127.0.0.1:40066
I20260810 01:41:02.266723 23383 tablet_service.cc:1514] Processing DeleteTablet for tablet 52da2d577ff8409597b69a4586f3e991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:02 UTC) from {username='slave'} at 127.0.0.1:37720
I20260810 01:41:02.267251 23737 tablet_replica.cc:330] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: stopping tablet replica
I20260810 01:41:02.267344 23736 tablet_replica.cc:330] T 52da2d577ff8409597b69a4586f3e991 P f530ac0966dc406c9f2092a0574ba25c: stopping tablet replica
I20260810 01:41:02.267511 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 23103
I20260810 01:41:02.284276 23735 tablet_replica.cc:330] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: stopping tablet replica
I20260810 01:41:02.284739 23735 raft_consensus.cc:2229] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:41:02.285212 23735 raft_consensus.cc:2258] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:02.288475 23735 ts_tablet_manager.cc:1905] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:02.291486 23735 ts_tablet_manager.cc:1918] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:02.291590 23735 log.cc:1196] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/52da2d577ff8409597b69a4586f3e991
I20260810 01:41:02.291925 23735 ts_tablet_manager.cc:1939] T 52da2d577ff8409597b69a4586f3e991 P a92b73c5d0d245bb8fd5eccdc1e156a9: Deleting consensus metadata
I20260810 01:41:02.293372 22990 catalog_manager.cc:4841] TS a92b73c5d0d245bb8fd5eccdc1e156a9 (127.24.205.131:44873): tablet 52da2d577ff8409597b69a4586f3e991 (table test-table [id=92665f0a541c49b286fb8a9da04fdd5d]) successfully deleted
I20260810 01:41:02.298612 23737 raft_consensus.cc:2229] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:02.299113 23737 raft_consensus.cc:2258] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:02.300812 23737 ts_tablet_manager.cc:1905] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:02.303208 23737 ts_tablet_manager.cc:1918] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:02.303335 23737 log.cc:1196] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/52da2d577ff8409597b69a4586f3e991
I20260810 01:41:02.303689 23737 ts_tablet_manager.cc:1939] T 52da2d577ff8409597b69a4586f3e991 P 046e3b2794e14baab2cffc6bd2baa81d: Deleting consensus metadata
I20260810 01:41:02.305013 22987 catalog_manager.cc:4841] TS 046e3b2794e14baab2cffc6bd2baa81d (127.24.205.130:41653): tablet 52da2d577ff8409597b69a4586f3e991 (table test-table [id=92665f0a541c49b286fb8a9da04fdd5d]) successfully deleted
W20260810 01:41:02.306002 22987 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:46653 (error 108)
I20260810 01:41:02.306978 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 23290
I20260810 01:41:02.307809 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:02.306793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:46653 (local address 127.0.0.1:38326)
0810 01:41:02.307599 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:02.307693 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:46653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":672}
W20260810 01:41:02.315172 22987 catalog_manager.cc:4584] TS f530ac0966dc406c9f2092a0574ba25c (127.24.205.129:46653): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 52da2d577ff8409597b69a4586f3e991: Network error: Client connection negotiation failed: client connection to 127.24.205.129:46653: connect: Connection refused (error 111)
I20260810 01:41:02.334755 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 23487
I20260810 01:41:02.351158 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 22961
2026-08-10T01:41:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1113 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:02 dist-test-slave-t3q3 krb5kdc[23742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:02 dist-test-slave-t3q3 krb5kdc[23742](info): set up 2 sockets
Aug 10 01:41:02 dist-test-slave-t3q3 krb5kdc[23742](info): commencing operation
krb5kdc: starting...
W20260810 01:41:03.632004 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:03 dist-test-slave-t3q3 krb5kdc[23742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:03.764882 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:40667
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:40667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:03.880007 23762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:03.880370 23762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:03.880456 23762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:03.884461 23762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:03.884564 23762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:03.884606 23762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:03.884675 23762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:03.884712 23762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:03.890094 23762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:40667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:40667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:03.891275 23762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:03.892445 23762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:03.901232 23770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:03.901304 23769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:03.901269 23774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:03.901541 23762 server_base.cc:1034] running on GCE node
I20260810 01:41:03.902192 23762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:03.903298 23762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:03.904501 23762 hybrid_clock.cc:648] HybridClock initialized: now 1786326063904486 us; error 28 us; skew 500 ppm
Aug 10 01:41:03 dist-test-slave-t3q3 krb5kdc[23742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326063, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:03.907290 23762 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:03.908234 23762 webserver.cc:460] Webserver started at http://127.24.205.190:40111/ using document root <none> and password file <none>
I20260810 01:41:03.908818 23762 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:03.908912 23762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:03.909154 23762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:03.911229 23762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "158d45d9a08b4fa7b9d68096bd87457c"
format_stamp: "Formatted at 2026-08-10 01:41:03 on dist-test-slave-t3q3"
server_key: "5e8b3d3760eb3a36072222eb4d42ed16"
server_key_iv: "e332515a471b14a6323e4b479ff7bcf4"
server_key_version: "encryptionkey@0"
I20260810 01:41:03.911820 23762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "158d45d9a08b4fa7b9d68096bd87457c"
format_stamp: "Formatted at 2026-08-10 01:41:03 on dist-test-slave-t3q3"
server_key: "5e8b3d3760eb3a36072222eb4d42ed16"
server_key_iv: "e332515a471b14a6323e4b479ff7bcf4"
server_key_version: "encryptionkey@0"
I20260810 01:41:03.915585 23762 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:03.918083 23782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:03.919353 23762 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:03.919499 23762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "158d45d9a08b4fa7b9d68096bd87457c"
format_stamp: "Formatted at 2026-08-10 01:41:03 on dist-test-slave-t3q3"
server_key: "5e8b3d3760eb3a36072222eb4d42ed16"
server_key_iv: "e332515a471b14a6323e4b479ff7bcf4"
server_key_version: "encryptionkey@0"
I20260810 01:41:03.919625 23762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:03.942879 23762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:03.946192 23762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:03.946429 23762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:03.953725 23762 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:40667
I20260810 01:41:03.953751 23858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:40667 every 8 connection(s)
I20260810 01:41:03.954705 23762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:03.957496 23859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:03.962814 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 23762
I20260810 01:41:03.962967 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:03.963308 25398 external_mini_cluster.cc:1428] Setting key 74a1171d4ac1101c2d0808c16768c73c
I20260810 01:41:03.963406 23859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c: Bootstrap starting.
I20260810 01:41:03.966053 23859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:03.966815 23859 log.cc:824] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:03.969192 23859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c: No bootstrap required, opened a new log
Aug 10 01:41:03 dist-test-slave-t3q3 krb5kdc[23742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:03.973753 23859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158d45d9a08b4fa7b9d68096bd87457c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40667 } }
I20260810 01:41:03.974045 23859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:03.974102 23859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158d45d9a08b4fa7b9d68096bd87457c, State: Initialized, Role: FOLLOWER
I20260810 01:41:03.974648 23859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158d45d9a08b4fa7b9d68096bd87457c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40667 } }
I20260810 01:41:03.974845 23859 raft_consensus.cc:388] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:03.974931 23859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:03.975030 23859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:03.976281 23859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158d45d9a08b4fa7b9d68096bd87457c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40667 } }
I20260810 01:41:03.976646 23859 leader_election.cc:302] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 158d45d9a08b4fa7b9d68096bd87457c; no voters:
I20260810 01:41:03.977035 23859 leader_election.cc:288] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:03.977146 23864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:03.977416 23864 raft_consensus.cc:686] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [term 1 LEADER]: Becoming Leader. State: Replica: 158d45d9a08b4fa7b9d68096bd87457c, State: Running, Role: LEADER
I20260810 01:41:03.977828 23864 consensus_queue.cc:237] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158d45d9a08b4fa7b9d68096bd87457c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40667 } }
I20260810 01:41:03.978406 23859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:03.979926 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:03.964758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53750 (local address 127.24.205.190:40667)
0810 01:41:03.965233 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:03.965248 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:03.965284 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:41:03.965913 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:03.965931 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:03.966321 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:03.966667 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:03.967580 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:03.969115 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:03.970045 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:03.970754 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:03.970925 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:03.973822 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:03.973829 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:03.973845 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:03.973877 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:03.976285 (+ 2408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:03.976761 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:03.976770 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:03.976776 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:03.976923 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:03.977328 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:03.977331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:03.977333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:03.977829 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:03.978048 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:03.978691 (+ 643us) server_negotiation.cc:299] Negotiation successful
0810 01:41:03.979009 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":136,"threads_started":1}
I20260810 01:41:03.981011 23865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 158d45d9a08b4fa7b9d68096bd87457c. Latest consensus state: current_term: 1 leader_uuid: "158d45d9a08b4fa7b9d68096bd87457c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158d45d9a08b4fa7b9d68096bd87457c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40667 } } }
I20260810 01:41:03.982673 23865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:03.980991 23866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "158d45d9a08b4fa7b9d68096bd87457c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158d45d9a08b4fa7b9d68096bd87457c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 40667 } } }
I20260810 01:41:03.983038 23866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c [sys.catalog]: This master's current role is: LEADER
W20260810 01:41:03.983750 23887 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:03.983846 23887 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:03.983940 23891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:03.984750 23891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:03.990782 23891 catalog_manager.cc:1347] Generated new cluster ID: 86945948b1114b8591e1af6ddc14d4cd
I20260810 01:41:03.990867 23891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:04.003448 23891 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:04.004917 23891 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:04.013576 23891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c: Generated new TSK 0
I20260810 01:41:04.014472 23891 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.205.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
Entry for principal kudu/127.24.205.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab.
I20260810 01:41:04.049696 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40667
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:04.168695 23898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:04.169044 23898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:04.169126 23898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:04.173858 23898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:04.173967 23898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:04.174065 23898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:41:04.179859 23898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.129.keytab
--principal=kudu/127.24.205.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:04.181221 23898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:04.182366 23898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:04.192561 23903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:04.192561 23904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:04.192596 23910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:04.192876 23898 server_base.cc:1034] running on GCE node
I20260810 01:41:04.193440 23898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:04.194221 23898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:04.195416 23898 hybrid_clock.cc:648] HybridClock initialized: now 1786326064195398 us; error 34 us; skew 500 ppm
Aug 10 01:41:04 dist-test-slave-t3q3 krb5kdc[23742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326064, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:04.198513 23898 init.cc:377] Logged in from keytab as kudu/127.24.205.129@KRBTEST.COM (short username kudu)
I20260810 01:41:04.199402 23898 webserver.cc:460] Webserver started at http://127.24.205.129:38013/ using document root <none> and password file <none>
I20260810 01:41:04.199968 23898 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:04.200034 23898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:04.200299 23898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:04.202428 23898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "302b72c88b47444cbf8cf54f5daf5174"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "f3ea6d06f8b1575f61b3e0c3c6de71ac"
server_key_iv: "c1135d6e5b213776f00869deafdac734"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.202975 23898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "302b72c88b47444cbf8cf54f5daf5174"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "f3ea6d06f8b1575f61b3e0c3c6de71ac"
server_key_iv: "c1135d6e5b213776f00869deafdac734"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.206840 23898 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:41:04.209709 23917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.210958 23898 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:04.211071 23898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "302b72c88b47444cbf8cf54f5daf5174"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "f3ea6d06f8b1575f61b3e0c3c6de71ac"
server_key_iv: "c1135d6e5b213776f00869deafdac734"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.211160 23898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:04.238485 23898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:04.241935 23898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:04.242100 23898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:04.242688 23898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:04.243578 23898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:04.243628 23898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.243672 23898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:04.243688 23898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.252673 23898 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:43043
I20260810 01:41:04.252697 24119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:43043 every 8 connection(s)
I20260810 01:41:04.253674 23898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:04.258558 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 23898
I20260810 01:41:04.258720 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:04.259021 25398 external_mini_cluster.cc:1428] Setting key d9c0472cd29b7d754b99cae9ecf45b86
Aug 10 01:41:04 dist-test-slave-t3q3 krb5kdc[23742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326064, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.129@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:04.268424 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.255583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:35723 (local address 127.24.205.190:40667)
0810 01:41:04.255737 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.255741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.256680 (+ 939us) server_negotiation.cc:407] Connection header received
0810 01:41:04.258015 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.258019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.258073 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.258191 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:04.259467 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.260007 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.261256 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.261499 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.261612 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.264092 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:04.264100 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:04.264106 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:04.264148 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:04.265915 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.266539 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.266543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.266545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.266639 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.267094 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.267101 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.267103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.267382 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:04.267499 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.267998 (+ 499us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.268215 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:41:04.269151 24122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.255981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:40667 (local address 127.24.205.129:35723)
0810 01:41:04.256517 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.256560 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.257801 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.258364 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.258371 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.258774 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:04.259325 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.259340 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.260226 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.260229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.261128 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.261139 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.261661 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.261666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.261829 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.262436 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:04.262452 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:04.263899 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:04.266042 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:04.266046 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:04.266058 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:04.266431 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:04.266789 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:04.266796 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:04.266798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:04.266985 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:04.267505 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:04.267510 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:04.267752 (+ 242us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.267908 (+ 156us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.268232 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":129,"threads_started":1}
I20260810 01:41:04.270438 24120 heartbeater.cc:347] Connected to a master server at 127.24.205.190:40667
WARNING: no policy specified for kudu/127.24.205.130@KRBTEST.COM; defaulting to no policy
I20260810 01:41:04.270694 24120 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:04.271185 24120 heartbeater.cc:511] Master 127.24.205.190:40667 requested a full tablet report, sending...
I20260810 01:41:04.272862 23803 ts_manager.cc:194] Registered new tserver with Master: 302b72c88b47444cbf8cf54f5daf5174 (127.24.205.129:43043)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.130@KRBTEST.COM" created.
I20260810 01:41:04.274166 23803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.129@KRBTEST.COM'} at 127.24.205.129:35723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
Entry for principal kudu/127.24.205.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab.
I20260810 01:41:04.288966 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40667
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:04.422351 24125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:04.422619 24125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:04.422662 24125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:04.426765 24125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:04.426828 24125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:04.426887 24125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:41:04.432473 24125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.130.keytab
--principal=kudu/127.24.205.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:04.433537 24125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:04.434535 24125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:41:04.444285 24125 server_base.cc:1034] running on GCE node
W20260810 01:41:04.444334 24134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:04.444294 24132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:04.444286 24136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:04.444914 24125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:04.445590 24125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:04.446751 24125 hybrid_clock.cc:648] HybridClock initialized: now 1786326064446719 us; error 55 us; skew 500 ppm
Aug 10 01:41:04 dist-test-slave-t3q3 krb5kdc[23742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326064, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:04.449693 24125 init.cc:377] Logged in from keytab as kudu/127.24.205.130@KRBTEST.COM (short username kudu)
I20260810 01:41:04.450565 24125 webserver.cc:460] Webserver started at http://127.24.205.130:34381/ using document root <none> and password file <none>
I20260810 01:41:04.451139 24125 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:04.451206 24125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:04.451438 24125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:04.453655 24125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "33fc68fd24fe4dc481ab4d857aa40aeb"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "02a8c85e19e43da9724ce737f53a9ec8"
server_key_iv: "cf29a2b9f3e560d4c831f0a9529023d3"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.454243 24125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "33fc68fd24fe4dc481ab4d857aa40aeb"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "02a8c85e19e43da9724ce737f53a9ec8"
server_key_iv: "cf29a2b9f3e560d4c831f0a9529023d3"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.458093 24125 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:41:04.460578 24147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.461812 24125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:04.461978 24125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "33fc68fd24fe4dc481ab4d857aa40aeb"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "02a8c85e19e43da9724ce737f53a9ec8"
server_key_iv: "cf29a2b9f3e560d4c831f0a9529023d3"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.462105 24125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:04.473802 24125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:04.476884 24125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:04.477089 24125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:04.477689 24125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:04.478615 24125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:04.478694 24125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.478760 24125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:04.478812 24125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.488160 24125 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:33517
I20260810 01:41:04.488204 24317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:33517 every 8 connection(s)
I20260810 01:41:04.489116 24125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:41:04.496248 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 24125
I20260810 01:41:04.496403 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:41:04.496697 25398 external_mini_cluster.cc:1428] Setting key 2882e27433ce17835866cd1ddf10b4e2
Aug 10 01:41:04 dist-test-slave-t3q3 krb5kdc[23742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326064, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.130@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:04.504086 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.491005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:57379 (local address 127.24.205.190:40667)
0810 01:41:04.491143 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.491148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.492086 (+ 938us) server_negotiation.cc:407] Connection header received
0810 01:41:04.493575 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.493579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.493637 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.493748 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:04.494946 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.495494 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.496915 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.497243 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.497350 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.499922 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:04.499930 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:04.499936 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:04.499971 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:04.501592 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.502276 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.502282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.502286 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.502385 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.502753 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.502760 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.502764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.503031 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:04.503151 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.503685 (+ 534us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.503842 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:41:04.504990 24322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.491360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:40667 (local address 127.24.205.130:57379)
0810 01:41:04.491848 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.491894 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.493329 (+ 1435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.493927 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.493934 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.494293 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:04.494793 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.494807 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.495631 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.495642 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.496730 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.496740 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.497433 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.497437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.497584 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.498249 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:04.498272 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:04.499751 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:04.501736 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:04.501744 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:04.501761 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:04.502161 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:04.502488 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:04.502491 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:04.502492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:04.502654 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:04.503149 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:04.503154 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:04.503413 (+ 259us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.503598 (+ 185us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.503881 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":118,"threads_started":1}
I20260810 01:41:04.506392 24320 heartbeater.cc:347] Connected to a master server at 127.24.205.190:40667
I20260810 01:41:04.506649 24320 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:04.507186 24320 heartbeater.cc:511] Master 127.24.205.190:40667 requested a full tablet report, sending...
I20260810 01:41:04.508343 23803 ts_manager.cc:194] Registered new tserver with Master: 33fc68fd24fe4dc481ab4d857aa40aeb (127.24.205.130:33517)
WARNING: no policy specified for kudu/127.24.205.131@KRBTEST.COM; defaulting to no policy
I20260810 01:41:04.509025 23803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.130@KRBTEST.COM'} at 127.24.205.130:57379
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
Entry for principal kudu/127.24.205.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab.
I20260810 01:41:04.527464 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40667
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:44173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:04.645548 24326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:04.645829 24326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:04.645900 24326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:04.649884 24326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:04.649967 24326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:04.650053 24326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:41:04.655471 24326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:44173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.131.keytab
--principal=kudu/127.24.205.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:40667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:04.656611 24326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:04.657635 24326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:04.667567 24332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:04.667632 24326 server_base.cc:1034] running on GCE node
W20260810 01:41:04.667549 24338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:04.667533 24333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:04.668359 24326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:04.669018 24326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:04.670220 24326 hybrid_clock.cc:648] HybridClock initialized: now 1786326064670188 us; error 47 us; skew 500 ppm
Aug 10 01:41:04 dist-test-slave-t3q3 krb5kdc[23742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326064, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:04.673151 24326 init.cc:377] Logged in from keytab as kudu/127.24.205.131@KRBTEST.COM (short username kudu)
I20260810 01:41:04.674244 24326 webserver.cc:460] Webserver started at http://127.24.205.131:33287/ using document root <none> and password file <none>
I20260810 01:41:04.674841 24326 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:04.674906 24326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:04.675081 24326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:04.677258 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "c2792ff760b14f3aaf8e2f98122c50cd"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "ab9128a014a2b0b990bfa1e11a198967"
server_key_iv: "449b263c199784d7442adfa8a1d5134e"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.677786 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "c2792ff760b14f3aaf8e2f98122c50cd"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "ab9128a014a2b0b990bfa1e11a198967"
server_key_iv: "449b263c199784d7442adfa8a1d5134e"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.681833 24326 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:41:04.684509 24349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.686286 24326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:41:04.686388 24326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "c2792ff760b14f3aaf8e2f98122c50cd"
format_stamp: "Formatted at 2026-08-10 01:41:04 on dist-test-slave-t3q3"
server_key: "ab9128a014a2b0b990bfa1e11a198967"
server_key_iv: "449b263c199784d7442adfa8a1d5134e"
server_key_version: "encryptionkey@0"
I20260810 01:41:04.686484 24326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:04.707473 24326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:04.711117 24326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:04.711308 24326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:04.711910 24326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:04.712867 24326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:04.712925 24326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.712967 24326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:04.713001 24326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:04.722131 24326 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:37299
I20260810 01:41:04.722216 24522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:37299 every 8 connection(s)
I20260810 01:41:04.723263 24326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:41:04.725327 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 24326
I20260810 01:41:04.725471 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:41:04.725790 25398 external_mini_cluster.cc:1428] Setting key 81bb028a3e889a93ba958bcb3033a34d
Aug 10 01:41:04 dist-test-slave-t3q3 krb5kdc[23742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326064, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.131@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:04.739769 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.725281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:53177 (local address 127.24.205.190:40667)
0810 01:41:04.725430 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.725435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.726653 (+ 1218us) server_negotiation.cc:407] Connection header received
0810 01:41:04.728557 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.728560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.728623 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.728757 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:04.730130 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.730690 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.731968 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.732304 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.732421 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.735782 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:04.735788 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:04.735794 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:04.735832 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:04.737612 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.738127 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.738130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.738132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.738216 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.738571 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.738578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.738580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.738797 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:04.738928 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.739469 (+ 541us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.739604 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:41:04.740937 24529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.725849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:40667 (local address 127.24.205.131:53177)
0810 01:41:04.726491 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.726539 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.728302 (+ 1763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.729033 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.729040 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.729421 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:04.729945 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.729959 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.730834 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.730838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.731825 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.731835 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.732469 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.732473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.732674 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.733397 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:04.733419 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:04.735527 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:04.737738 (+ 2211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:04.737743 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:04.737757 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:04.738027 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:04.738304 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:04.738307 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:04.738308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:04.738464 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:04.738924 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:04.738932 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:04.739220 (+ 288us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.739426 (+ 206us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.739886 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":161,"threads_started":1}
I20260810 01:41:04.742069 24523 heartbeater.cc:347] Connected to a master server at 127.24.205.190:40667
I20260810 01:41:04.742386 24523 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:04.742946 24523 heartbeater.cc:511] Master 127.24.205.190:40667 requested a full tablet report, sending...
I20260810 01:41:04.744175 23803 ts_manager.cc:194] Registered new tserver with Master: c2792ff760b14f3aaf8e2f98122c50cd (127.24.205.131:37299)
I20260810 01:41:04.744789 23803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.205.131@KRBTEST.COM'} at 127.24.205.131:53177
I20260810 01:41:04.752621 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:41:04.763244 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.755076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.24.205.190:40667)
0810 01:41:04.755259 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.755264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.755446 (+ 182us) server_negotiation.cc:407] Connection header received
0810 01:41:04.755641 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.755650 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.755696 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.755787 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:04.756685 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.757227 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.758114 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.758340 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.758449 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.759892 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:04.759896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:04.759898 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:04.759921 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:04.761451 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.761917 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.761922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.761924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.762012 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:04.762311 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:04.762315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:04.762317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:04.762547 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:04.762695 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.762939 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.763072 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:41:04.766472 23803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:41:04.769729 23803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:04.785072 24550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.779333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32776 (local address 127.24.205.130:33517)
0810 01:41:04.779842 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.779854 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.780116 (+ 262us) server_negotiation.cc:407] Connection header received
0810 01:41:04.780233 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.780237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.780377 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.780520 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:04.780951 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.782097 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.783602 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.784287 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.784429 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.784581 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.784814 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.784914 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":155,"threads_started":1}
I20260810 01:41:04.785063 24547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.778829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:33517 (local address 127.0.0.1:32776)
0810 01:41:04.779971 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.779984 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.780129 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.780678 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.780681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.780696 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:04.780825 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.780832 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.782237 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.782239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.783471 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.783480 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.784429 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.784432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.784614 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.784659 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.784781 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.784864 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"mutex_wait_us":72,"thread_start_us":107,"threads_started":1}
I20260810 01:41:04.785073 24546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.778511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43043 (local address 127.0.0.1:47244)
0810 01:41:04.779156 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.779206 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.779341 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.780529 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.780532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.780550 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:04.780685 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.780692 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.781805 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.781812 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.783371 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.783383 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.784469 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.784473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.784597 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.784652 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.784738 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.784870 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":102,"thread_start_us":77,"threads_started":1}
I20260810 01:41:04.785073 24549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.778552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:37299 (local address 127.0.0.1:55878)
0810 01:41:04.779657 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.779671 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.779759 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.780424 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.780430 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.780453 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:04.780604 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.780611 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.782195 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.782199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.783241 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.783251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.784676 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.784679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.784767 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.784787 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.784850 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.784909 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":36,"thread_start_us":112,"threads_started":1}
I20260810 01:41:04.785967 24553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.779334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55878 (local address 127.24.205.131:37299)
0810 01:41:04.779837 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.779852 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.779880 (+ 28us) server_negotiation.cc:407] Connection header received
0810 01:41:04.779965 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.779971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.780258 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.780439 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:04.780786 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.782025 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.783382 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.784324 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.784461 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.784613 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.785140 (+ 527us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.785643 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":144,"threads_started":1}
I20260810 01:41:04.786111 24548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.778671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47244 (local address 127.24.205.129:43043)
0810 01:41:04.779998 (+ 1327us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.780005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.780028 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:41:04.780154 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.780160 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.780356 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.780839 (+ 483us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:04.780997 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.781687 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.783504 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.784324 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.785654 (+ 1330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.785788 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.785838 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.785938 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1218,"thread_start_us":128,"threads_started":1}
I20260810 01:41:04.788527 24424 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c (DEFAULT_TABLE table=test-table [id=989cd517271d4bf499d54fbb9a30971d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:04.788607 24215 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c (DEFAULT_TABLE table=test-table [id=989cd517271d4bf499d54fbb9a30971d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:04.788599 24005 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c (DEFAULT_TABLE table=test-table [id=989cd517271d4bf499d54fbb9a30971d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:04.789667 24215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:04.789666 24005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:04.789680 24424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:04.796241 24554 tablet_bootstrap.cc:492] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Bootstrap starting.
I20260810 01:41:04.797744 24555 tablet_bootstrap.cc:492] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174: Bootstrap starting.
I20260810 01:41:04.798768 24554 tablet_bootstrap.cc:654] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:04.800047 24555 tablet_bootstrap.cc:654] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:04.800179 24554 log.cc:824] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:04.800933 24556 tablet_bootstrap.cc:492] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Bootstrap starting.
I20260810 01:41:04.800937 24555 log.cc:824] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:04.802297 24554 tablet_bootstrap.cc:492] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: No bootstrap required, opened a new log
I20260810 01:41:04.802527 24554 ts_tablet_manager.cc:1397] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:04.802953 24555 tablet_bootstrap.cc:492] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174: No bootstrap required, opened a new log
I20260810 01:41:04.803057 24556 tablet_bootstrap.cc:654] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:04.803156 24555 ts_tablet_manager.cc:1397] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 01:41:04.804340 24556 log.cc:824] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:04.805958 24554 raft_consensus.cc:348] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.806212 24554 raft_consensus.cc:374] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:04.806278 24554 raft_consensus.cc:729] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2792ff760b14f3aaf8e2f98122c50cd, State: Initialized, Role: FOLLOWER
I20260810 01:41:04.806429 24556 tablet_bootstrap.cc:492] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: No bootstrap required, opened a new log
I20260810 01:41:04.806674 24556 ts_tablet_manager.cc:1397] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:04.806820 24554 consensus_queue.cc:260] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.807663 24555 raft_consensus.cc:348] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.807894 24554 ts_tablet_manager.cc:1428] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:41:04.807938 24555 raft_consensus.cc:374] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:04.807947 24523 heartbeater.cc:503] Master 127.24.205.190:40667 was elected leader, sending a full tablet report...
I20260810 01:41:04.807994 24555 raft_consensus.cc:729] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 302b72c88b47444cbf8cf54f5daf5174, State: Initialized, Role: FOLLOWER
I20260810 01:41:04.808460 24555 consensus_queue.cc:260] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.809162 24120 heartbeater.cc:503] Master 127.24.205.190:40667 was elected leader, sending a full tablet report...
I20260810 01:41:04.809422 24555 ts_tablet_manager.cc:1428] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:41:04.810556 24556 raft_consensus.cc:348] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.810842 24556 raft_consensus.cc:374] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:04.810902 24556 raft_consensus.cc:729] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33fc68fd24fe4dc481ab4d857aa40aeb, State: Initialized, Role: FOLLOWER
I20260810 01:41:04.811383 24556 consensus_queue.cc:260] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.812156 24320 heartbeater.cc:503] Master 127.24.205.190:40667 was elected leader, sending a full tablet report...
I20260810 01:41:04.812351 24556 ts_tablet_manager.cc:1428] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:04.888305 24561 raft_consensus.cc:482] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:04.888567 24561 raft_consensus.cc:504] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.889866 24561 leader_election.cc:288] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 302b72c88b47444cbf8cf54f5daf5174 (127.24.205.129:43043), 33fc68fd24fe4dc481ab4d857aa40aeb (127.24.205.130:33517)
I20260810 01:41:04.893921 24529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.890171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43043 (local address 127.24.205.131:40487)
0810 01:41:04.890287 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.890309 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.890409 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.890792 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.890795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.890814 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:04.890941 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.890948 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.891797 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.891802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.892763 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.892773 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.893468 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.893471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.893586 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.893605 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.893706 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.893783 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 01:41:04.893921 24548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.890413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:40487 (local address 127.24.205.129:43043)
0810 01:41:04.890552 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.890556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.890571 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:41:04.890622 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.890624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.890668 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.890775 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:04.891112 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.891683 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.892901 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.893338 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.893477 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.893537 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.893722 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.893802 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:41:04.894184 24567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.890171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:33517 (local address 127.24.205.131:48793)
0810 01:41:04.890823 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:04.890838 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:04.890979 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:04.891249 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:04.891252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:04.891268 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:04.891428 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.891434 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.892186 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.892191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.893083 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:04.893093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.893741 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.893744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:04.893851 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.893872 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:41:04.893967 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 01:41:04.894032 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":310,"thread_start_us":152,"threads_started":1}
I20260810 01:41:04.894160 24550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.890290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:48793 (local address 127.24.205.130:33517)
0810 01:41:04.890427 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.890433 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.890929 (+ 496us) server_negotiation.cc:407] Connection header received
0810 01:41:04.891068 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.891071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.891123 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.891236 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:04.891539 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.892051 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.893219 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.893612 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.893742 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.893794 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.893982 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.894048 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:41:04.894624 24035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb3cc9a799a4be7bfa0ed58e2c1ef8c" candidate_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "302b72c88b47444cbf8cf54f5daf5174" is_pre_election: true
I20260810 01:41:04.894806 24246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb3cc9a799a4be7bfa0ed58e2c1ef8c" candidate_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" is_pre_election: true
I20260810 01:41:04.894976 24035 raft_consensus.cc:2454] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2792ff760b14f3aaf8e2f98122c50cd in term 0.
I20260810 01:41:04.895057 24246 raft_consensus.cc:2454] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2792ff760b14f3aaf8e2f98122c50cd in term 0.
I20260810 01:41:04.895495 24355 leader_election.cc:302] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 302b72c88b47444cbf8cf54f5daf5174, c2792ff760b14f3aaf8e2f98122c50cd; no voters:
I20260810 01:41:04.895749 24561 raft_consensus.cc:2781] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:04.895850 24561 raft_consensus.cc:482] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:04.895913 24561 raft_consensus.cc:3037] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:04.897012 24561 raft_consensus.cc:504] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.897403 24561 leader_election.cc:288] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [CANDIDATE]: Term 1 election: Requested vote from peers 302b72c88b47444cbf8cf54f5daf5174 (127.24.205.129:43043), 33fc68fd24fe4dc481ab4d857aa40aeb (127.24.205.130:33517)
I20260810 01:41:04.897749 24246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb3cc9a799a4be7bfa0ed58e2c1ef8c" candidate_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb"
I20260810 01:41:04.897756 24035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb3cc9a799a4be7bfa0ed58e2c1ef8c" candidate_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "302b72c88b47444cbf8cf54f5daf5174"
I20260810 01:41:04.897888 24246 raft_consensus.cc:3037] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:04.897903 24035 raft_consensus.cc:3037] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:04.899237 24035 raft_consensus.cc:2454] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2792ff760b14f3aaf8e2f98122c50cd in term 1.
I20260810 01:41:04.899295 24246 raft_consensus.cc:2454] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2792ff760b14f3aaf8e2f98122c50cd in term 1.
I20260810 01:41:04.899564 24355 leader_election.cc:302] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 302b72c88b47444cbf8cf54f5daf5174, c2792ff760b14f3aaf8e2f98122c50cd; no voters:
I20260810 01:41:04.899762 24561 raft_consensus.cc:2781] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:04.900024 24561 raft_consensus.cc:686] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 1 LEADER]: Becoming Leader. State: Replica: c2792ff760b14f3aaf8e2f98122c50cd, State: Running, Role: LEADER
I20260810 01:41:04.900432 24561 consensus_queue.cc:237] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } }
I20260810 01:41:04.903515 23802 catalog_manager.cc:5495] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c2792ff760b14f3aaf8e2f98122c50cd (127.24.205.131). New cstate: current_term: 1 leader_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2792ff760b14f3aaf8e2f98122c50cd" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 37299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 } health_report { overall_health: UNKNOWN } } }
I20260810 01:41:04.938150 24553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:04.934532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.24.205.131:37299)
0810 01:41:04.934672 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:04.934676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:04.934691 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:41:04.934841 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:04.934843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:04.934904 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:04.934998 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:04.935260 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.935772 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.936636 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:04.936859 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:04.936940 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:04.937275 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:04.937728 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:04.937824 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:04.937887 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 01:41:04.937941 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:41:04.944520 24246 raft_consensus.cc:1261] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 1 FOLLOWER]: Refusing update from remote peer c2792ff760b14f3aaf8e2f98122c50cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:04.944535 24035 raft_consensus.cc:1261] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 302b72c88b47444cbf8cf54f5daf5174 [term 1 FOLLOWER]: Refusing update from remote peer c2792ff760b14f3aaf8e2f98122c50cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:04.945417 24569 consensus_queue.cc:1035] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "302b72c88b47444cbf8cf54f5daf5174" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 43043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:04.945644 24561 consensus_queue.cc:1035] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "33fc68fd24fe4dc481ab4d857aa40aeb" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 33517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:04.952423 24577 mvcc.cc:205] Tried to move back new op lower bound from 7316791562004422656 to 7316791561834696704. Current Snapshot: MvccSnapshot[applied={T|T < 7316791562004422656}]
I20260810 01:41:04.963297 23803 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:04.963481 23803 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:04.966068 23803 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 158d45d9a08b4fa7b9d68096bd87457c: Sending DeleteTablet for 3 replicas of tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c
I20260810 01:41:04.966915 24424 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:04 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:55878
I20260810 01:41:04.967041 24215 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:04 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:32776
I20260810 01:41:04.967604 24593 tablet_replica.cc:330] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: stopping tablet replica
I20260810 01:41:04.967986 24005 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:04 UTC) from {username='kudu', principal='kudu/127.24.205.190@KRBTEST.COM'} at 127.0.0.1:47244
I20260810 01:41:04.968386 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 23898
I20260810 01:41:04.968492 24596 tablet_replica.cc:330] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: stopping tablet replica
I20260810 01:41:04.968797 24596 raft_consensus.cc:2229] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:04.971158 24596 raft_consensus.cc:2258] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:04.975518 24596 ts_tablet_manager.cc:1905] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:04.978921 24596 ts_tablet_manager.cc:1918] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:04.979010 24596 log.cc:1196] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/5bb3cc9a799a4be7bfa0ed58e2c1ef8c
I20260810 01:41:04.979290 24596 ts_tablet_manager.cc:1939] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P 33fc68fd24fe4dc481ab4d857aa40aeb: Deleting consensus metadata
I20260810 01:41:04.980857 23783 catalog_manager.cc:4841] TS 33fc68fd24fe4dc481ab4d857aa40aeb (127.24.205.130:33517): tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c (table test-table [id=989cd517271d4bf499d54fbb9a30971d]) successfully deleted
I20260810 01:41:04.988451 24593 raft_consensus.cc:2229] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:41:04.988898 24593 raft_consensus.cc:2258] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:04.991412 24593 ts_tablet_manager.cc:1905] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:04.995012 24593 ts_tablet_manager.cc:1918] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:04.995153 24593 log.cc:1196] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/5bb3cc9a799a4be7bfa0ed58e2c1ef8c
I20260810 01:41:04.995509 24593 ts_tablet_manager.cc:1939] T 5bb3cc9a799a4be7bfa0ed58e2c1ef8c P c2792ff760b14f3aaf8e2f98122c50cd: Deleting consensus metadata
I20260810 01:41:04.996870 23784 catalog_manager.cc:4841] TS c2792ff760b14f3aaf8e2f98122c50cd (127.24.205.131:37299): tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c (table test-table [id=989cd517271d4bf499d54fbb9a30971d]) successfully deleted
W20260810 01:41:04.999188 23787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:43043 (error 108)
I20260810 01:41:05.000104 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 24125
I20260810 01:41:05.000483 24549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.000037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:43043 (local address 127.0.0.1:47248)
0810 01:41:05.000300 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:05.000383 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
W20260810 01:41:05.002997 23787 catalog_manager.cc:4584] TS 302b72c88b47444cbf8cf54f5daf5174 (127.24.205.129:43043): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5bb3cc9a799a4be7bfa0ed58e2c1ef8c: Network error: Client connection negotiation failed: client connection to 127.24.205.129:43043: connect: Connection refused (error 111)
I20260810 01:41:05.011237 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 24326
I20260810 01:41:05.025314 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 23762
2026-08-10T01:41:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2671 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T01:41:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:05Z Disabled control of system clock
I20260810 01:41:05.062927 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46603
--webserver_interface=127.24.205.190
--webserver_port=0
--builtin_ntp_servers=127.24.205.148:36371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:46603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:41:05.179414 24607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:05.179705 24607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:05.179742 24607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:05.183687 24607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:05.183756 24607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:05.183772 24607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:05.183789 24607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:05.183805 24607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:05.188723 24607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:46603
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:46603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:05.189877 24607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:05.191283 24607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:05.200191 24619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:05.200222 24620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:05.200287 24607 server_base.cc:1034] running on GCE node
W20260810 01:41:05.200191 24622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:05.201031 24607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:05.202214 24607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:05.203428 24607 hybrid_clock.cc:648] HybridClock initialized: now 1786326065203409 us; error 32 us; skew 500 ppm
I20260810 01:41:05.209069 24607 webserver.cc:460] Webserver started at http://127.24.205.190:43205/ using document root <none> and password file <none>
I20260810 01:41:05.209735 24607 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:05.209837 24607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:05.210160 24607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:05.212448 24607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "08c598121f1cd625862ef52d0bbe5927"
server_key_iv: "c57b7dcde58f14cddf7337486b7eb37e"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.213088 24607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "08c598121f1cd625862ef52d0bbe5927"
server_key_iv: "c57b7dcde58f14cddf7337486b7eb37e"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.217145 24607 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:41:05.219847 24629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.221235 24607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:05.221396 24607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "08c598121f1cd625862ef52d0bbe5927"
server_key_iv: "c57b7dcde58f14cddf7337486b7eb37e"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.221534 24607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:05.251780 24607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:05.252700 24607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:05.252914 24607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:05.260504 24607 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:46603
I20260810 01:41:05.260550 24720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:46603 every 8 connection(s)
I20260810 01:41:05.261567 24607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:05.265131 24722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:05.270036 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 24607
I20260810 01:41:05.270210 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:05.270515 25398 external_mini_cluster.cc:1428] Setting key 22efb2383536fc0fac04df072194730d
I20260810 01:41:05.271250 24722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45: Bootstrap starting.
I20260810 01:41:05.273746 24722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:05.274681 24722 log.cc:824] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:05.277161 24722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45: No bootstrap required, opened a new log
I20260810 01:41:05.280764 24728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.272140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60812 (local address 127.24.205.190:46603)
0810 01:41:05.272786 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.272800 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.272837 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:41:05.273522 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.273540 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.274002 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.274300 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:05.274668 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.275926 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.277249 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.277759 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.277894 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.278846 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:05.278851 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:05.278865 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:05.279294 (+ 429us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:05.279351 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:05.279371 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:05.279453 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.279638 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.279939 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":136,"threads_started":1}
I20260810 01:41:05.281518 24722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46603 } }
I20260810 01:41:05.281747 24722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:05.281810 24722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c59c44fdb4b4b6ba7a6baf8e0e0ba45, State: Initialized, Role: FOLLOWER
I20260810 01:41:05.282413 24722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46603 } }
I20260810 01:41:05.282563 24722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:05.282671 24722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:05.282806 24722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:05.283903 24722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46603 } }
I20260810 01:41:05.284304 24722 leader_election.cc:302] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c59c44fdb4b4b6ba7a6baf8e0e0ba45; no voters:
I20260810 01:41:05.284631 24722 leader_election.cc:288] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:05.284768 24736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:05.285326 24736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [term 1 LEADER]: Becoming Leader. State: Replica: 7c59c44fdb4b4b6ba7a6baf8e0e0ba45, State: Running, Role: LEADER
I20260810 01:41:05.285655 24736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46603 } }
I20260810 01:41:05.286144 24722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:05.287369 24739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c59c44fdb4b4b6ba7a6baf8e0e0ba45. Latest consensus state: current_term: 1 leader_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46603 } } }
I20260810 01:41:05.287516 24739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:05.287842 24737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c59c44fdb4b4b6ba7a6baf8e0e0ba45" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 46603 } } }
I20260810 01:41:05.287959 24737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:05.288054 24753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:05.291170 24753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:05.296623 24753 catalog_manager.cc:1347] Generated new cluster ID: 319b724ab0354989bf09775ebf25317b
I20260810 01:41:05.296698 24753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:05.314949 24753 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:05.316406 24753 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:05.323518 24753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45: Generated new TSK 0
I20260810 01:41:05.324417 24753 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:05.330436 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.129:0
--local_ip_for_outbound_sockets=127.24.205.129
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46603
--builtin_ntp_servers=127.24.205.148:36371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:41:05.446939 24769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:05.447327 24769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:05.447409 24769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:05.451463 24769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:05.451560 24769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:05.451653 24769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.129
I20260810 01:41:05.456804 24769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.205.129
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.129
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:05.458042 24769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:05.459461 24769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:05.468972 24777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:05.468941 24779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:05.468979 24781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:05.469280 24769 server_base.cc:1034] running on GCE node
I20260810 01:41:05.469748 24769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:05.470369 24769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:05.471556 24769 hybrid_clock.cc:648] HybridClock initialized: now 1786326065471539 us; error 28 us; skew 500 ppm
I20260810 01:41:05.473523 24769 webserver.cc:460] Webserver started at http://127.24.205.129:45675/ using document root <none> and password file <none>
I20260810 01:41:05.474103 24769 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:05.474167 24769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:05.474385 24769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:05.476444 24769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data/instance:
uuid: "be1e3c6e734d43b0acae7843971f61e9"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "7803da53f73da5c85f3ef82a448ef741"
server_key_iv: "33487f01d679aff3ce02afb3ccf8a679"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.477008 24769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance:
uuid: "be1e3c6e734d43b0acae7843971f61e9"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "7803da53f73da5c85f3ef82a448ef741"
server_key_iv: "33487f01d679aff3ce02afb3ccf8a679"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.481035 24769 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:41:05.483603 24791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.485004 24769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:41:05.485146 24769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/wal
uuid: "be1e3c6e734d43b0acae7843971f61e9"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "7803da53f73da5c85f3ef82a448ef741"
server_key_iv: "33487f01d679aff3ce02afb3ccf8a679"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.485265 24769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:05.504256 24769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:05.505070 24769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:05.505278 24769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:05.505934 24769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:05.506949 24769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:05.507038 24769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.507134 24769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:05.507186 24769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.516268 24769 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.129:36287
I20260810 01:41:05.516296 24971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.129:36287 every 8 connection(s)
I20260810 01:41:05.517213 24769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:05.518383 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 24769
I20260810 01:41:05.518522 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:05.518879 25398 external_mini_cluster.cc:1428] Setting key 5229f079dd178fe27514d2006ea4dd6b
I20260810 01:41:05.521099 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.130:0
--local_ip_for_outbound_sockets=127.24.205.130
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46603
--builtin_ntp_servers=127.24.205.148:36371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:41:05.527631 24728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.519144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:37627 (local address 127.24.205.190:46603)
0810 01:41:05.519311 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.519316 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.520624 (+ 1308us) server_negotiation.cc:407] Connection header received
0810 01:41:05.522134 (+ 1510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.522141 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.522218 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.522316 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:05.523258 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.524161 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.525477 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.525715 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.525830 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.527102 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:05.527106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:05.527109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:05.527129 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:05.527149 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:05.527157 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:05.527239 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.527408 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.527476 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:41:05.528563 24975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.519672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46603 (local address 127.24.205.129:37627)
0810 01:41:05.520456 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:05.520511 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:05.521900 (+ 1389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:05.522480 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:05.522487 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:05.522578 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:05.523108 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.523121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.524326 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.524332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.525327 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.525337 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.525875 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.525879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.526090 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.526795 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:41:05.526796 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:05.526838 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:41:05.526904 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:05.527242 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:05.527254 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:05.527261 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:41:05.527396 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 01:41:05.527685 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":137,"threads_started":1}
I20260810 01:41:05.530078 24972 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46603
I20260810 01:41:05.530339 24972 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:05.530905 24972 heartbeater.cc:511] Master 127.24.205.190:46603 requested a full tablet report, sending...
I20260810 01:41:05.532466 24662 ts_manager.cc:194] Registered new tserver with Master: be1e3c6e734d43b0acae7843971f61e9 (127.24.205.129:36287)
I20260810 01:41:05.533614 24662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.129:37627
W20260810 01:41:05.637065 24976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:05.637351 24976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:05.637391 24976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:05.641494 24976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:05.641559 24976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:05.641647 24976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.130
I20260810 01:41:05.646428 24976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.205.130
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.130
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:05.647552 24976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:05.649058 24976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:05.658924 24990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:05.659011 24988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:05.658932 24987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:05.658994 24976 server_base.cc:1034] running on GCE node
I20260810 01:41:05.659502 24976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:05.660108 24976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:05.661310 24976 hybrid_clock.cc:648] HybridClock initialized: now 1786326065661298 us; error 32 us; skew 500 ppm
I20260810 01:41:05.663153 24976 webserver.cc:460] Webserver started at http://127.24.205.130:34627/ using document root <none> and password file <none>
I20260810 01:41:05.663743 24976 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:05.663838 24976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:05.664134 24976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:05.666180 24976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data/instance:
uuid: "5c5e42e9872f4dd0aa4901ec1df8c700"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "0086e27770037f3d89702859c9873a00"
server_key_iv: "23bd4bad01376249b01b3a693a475268"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.666761 24976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance:
uuid: "5c5e42e9872f4dd0aa4901ec1df8c700"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "0086e27770037f3d89702859c9873a00"
server_key_iv: "23bd4bad01376249b01b3a693a475268"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.670632 24976 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 01:41:05.673126 24998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.674326 24976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:05.674461 24976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal
uuid: "5c5e42e9872f4dd0aa4901ec1df8c700"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "0086e27770037f3d89702859c9873a00"
server_key_iv: "23bd4bad01376249b01b3a693a475268"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.674582 24976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:05.707129 24976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:05.707921 24976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:05.708191 24976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:05.708858 24976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:05.709923 24976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:05.709997 24976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.710067 24976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:05.710119 24976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.718940 24976 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.130:42453
I20260810 01:41:05.718964 25165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.130:42453 every 8 connection(s)
I20260810 01:41:05.719964 24976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/data/info.pb
I20260810 01:41:05.729702 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 24976
I20260810 01:41:05.729837 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal/instance
I20260810 01:41:05.729842 24728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.721918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.130:59435 (local address 127.24.205.190:46603)
0810 01:41:05.722073 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.722078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.723225 (+ 1147us) server_negotiation.cc:407] Connection header received
0810 01:41:05.724738 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.724741 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.724791 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.724895 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:05.725946 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.726489 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.727661 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.727910 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.727999 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.729300 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:05.729304 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:05.729306 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:05.729318 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:05.729340 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:05.729348 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:05.729412 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.729619 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.729676 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:41:05.730191 25398 external_mini_cluster.cc:1428] Setting key 2aacc85d5a295517a35a0273e3ad102a
I20260810 01:41:05.730963 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.722392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46603 (local address 127.24.205.130:59435)
0810 01:41:05.723072 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:05.723114 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:05.724486 (+ 1372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:05.725089 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:05.725100 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:05.725200 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:05.725773 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.725789 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.726624 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.726627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.727531 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.727541 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.728111 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.728118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.728317 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.729037 (+ 720us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:41:05.729038 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:05.729083 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:41:05.729149 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:05.729441 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:05.729450 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:05.729456 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:41:05.729622 (+ 166us) client_negotiation.cc:240] Negotiation successful
0810 01:41:05.729935 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":118,"threads_started":1}
I20260810 01:41:05.732287 25166 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46603
I20260810 01:41:05.732491 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.205.131:0
--local_ip_for_outbound_sockets=127.24.205.131
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46603
--builtin_ntp_servers=127.24.205.148:36371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:41:05.732547 25166 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:05.733235 25166 heartbeater.cc:511] Master 127.24.205.190:46603 requested a full tablet report, sending...
I20260810 01:41:05.734344 24662 ts_manager.cc:194] Registered new tserver with Master: 5c5e42e9872f4dd0aa4901ec1df8c700 (127.24.205.130:42453)
I20260810 01:41:05.734920 24662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.130:59435
W20260810 01:41:05.847487 25172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:05.847766 25172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:05.847805 25172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:05.851707 25172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:05.851761 25172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:05.851815 25172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.205.131
I20260810 01:41:05.856622 25172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:36371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.205.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.205.131
--webserver_port=0
--tserver_master_addrs=127.24.205.190:46603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.205.131
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:05.857688 25172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:05.859051 25172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:05.868803 25184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:05.868798 25186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:05.868870 25172 server_base.cc:1034] running on GCE node
W20260810 01:41:05.868803 25189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:05.869599 25172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:05.870288 25172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:05.871482 25172 hybrid_clock.cc:648] HybridClock initialized: now 1786326065871463 us; error 29 us; skew 500 ppm
I20260810 01:41:05.873414 25172 webserver.cc:460] Webserver started at http://127.24.205.131:39465/ using document root <none> and password file <none>
I20260810 01:41:05.874011 25172 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:05.874104 25172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:05.874329 25172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:05.876482 25172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data/instance:
uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "0fa848d1417eb505df6986c4ce048903"
server_key_iv: "2c761e9f8908803ad8c32d4cf2500d7c"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.877074 25172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance:
uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "0fa848d1417eb505df6986c4ce048903"
server_key_iv: "2c761e9f8908803ad8c32d4cf2500d7c"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.881217 25172 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 01:41:05.883744 25200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.885082 25172 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:05.885224 25172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal
uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7"
format_stamp: "Formatted at 2026-08-10 01:41:05 on dist-test-slave-t3q3"
server_key: "0fa848d1417eb505df6986c4ce048903"
server_key_iv: "2c761e9f8908803ad8c32d4cf2500d7c"
server_key_version: "encryptionkey@0"
I20260810 01:41:05.885344 25172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:05.905089 25172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:05.905892 25172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:05.906111 25172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:05.906756 25172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:05.907775 25172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:05.907850 25172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.907924 25172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:05.907994 25172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:05.917012 25172 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.131:40921
I20260810 01:41:05.917037 25380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.131:40921 every 8 connection(s)
I20260810 01:41:05.917999 25172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/data/info.pb
I20260810 01:41:05.920207 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25172
I20260810 01:41:05.920336 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal/instance
I20260810 01:41:05.920629 25398 external_mini_cluster.cc:1428] Setting key 258262fb6b549f2ff543aceee42ea329
I20260810 01:41:05.927867 24728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.919980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:54861 (local address 127.24.205.190:46603)
0810 01:41:05.920186 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.920191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.921362 (+ 1171us) server_negotiation.cc:407] Connection header received
0810 01:41:05.922841 (+ 1479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.922844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.922906 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.922987 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:05.923935 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.924495 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.925758 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.925988 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.926124 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.927293 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:05.927303 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:05.927305 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:05.927317 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:05.927338 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:05.927347 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:05.927429 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.927640 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.927721 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260810 01:41:05.928812 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.920456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:46603 (local address 127.24.205.131:54861)
0810 01:41:05.921206 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:05.921259 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:05.922623 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:05.923169 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:05.923177 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:05.923265 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:05.923785 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.923798 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.924644 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.924647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.925628 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.925637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.926165 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.926169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.926354 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.926990 (+ 636us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:41:05.926991 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:05.927035 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:41:05.927107 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:05.927447 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:05.927458 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:05.927466 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 01:41:05.927640 (+ 174us) client_negotiation.cc:240] Negotiation successful
0810 01:41:05.927949 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":140,"threads_started":1}
I20260810 01:41:05.929993 25383 heartbeater.cc:347] Connected to a master server at 127.24.205.190:46603
I20260810 01:41:05.930261 25383 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:05.930835 25383 heartbeater.cc:511] Master 127.24.205.190:46603 requested a full tablet report, sending...
I20260810 01:41:05.931924 24662 ts_manager.cc:194] Registered new tserver with Master: 8a1dd4f4afeb4dac9a8390469fdec4c7 (127.24.205.131:40921)
I20260810 01:41:05.932533 24662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.205.131:54861
I20260810 01:41:05.934633 25398 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:41:05.940742 24728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.936646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60824 (local address 127.24.205.190:46603)
0810 01:41:05.936778 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.936782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.937000 (+ 218us) server_negotiation.cc:407] Connection header received
0810 01:41:05.937187 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.937190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.937242 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.937326 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:05.937607 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.938120 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.938982 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.939219 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.939333 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.940232 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:05.940236 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:05.940239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:05.940252 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:05.940273 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:05.940281 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:05.940372 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.940509 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.940576 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:41:05.943605 24662 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:41:05.946964 24662 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:05.962007 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.957171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60212 (local address 127.24.205.129:36287)
0810 01:41:05.957497 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.957510 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.957535 (+ 25us) server_negotiation.cc:407] Connection header received
0810 01:41:05.957633 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.957638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.957837 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.958013 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:05.958398 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.959142 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.960481 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.961291 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.961421 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.961609 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.961741 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.961834 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":129,"threads_started":1}
I20260810 01:41:05.962025 25405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.956088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:36287 (local address 127.0.0.1:60212)
0810 01:41:05.956987 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:05.957002 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:05.957093 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:05.958182 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:05.958184 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:05.958198 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:05.958276 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.958279 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.959266 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.959270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.960309 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.960340 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.961439 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.961442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.961551 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.961589 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 01:41:05.961718 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 01:41:05.961851 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":27,"thread_start_us":123,"threads_started":1}
I20260810 01:41:05.962357 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.956147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51614 (local address 127.24.205.131:40921)
0810 01:41:05.956972 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.956984 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.957014 (+ 30us) server_negotiation.cc:407] Connection header received
0810 01:41:05.957100 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.957105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.957356 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.957961 (+ 605us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:05.958123 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.958875 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.960666 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.961381 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.961482 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.961652 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.962044 (+ 392us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.962175 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":124,"threads_started":1}
I20260810 01:41:05.962792 25396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.955985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40921 (local address 127.0.0.1:51614)
0810 01:41:05.956340 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:05.956386 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:05.956514 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:05.957563 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:05.957570 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:05.957596 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:05.957763 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.957769 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.958998 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.959003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.960528 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.960540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.961753 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.961756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.961884 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.961904 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:41:05.962585 (+ 681us) client_negotiation.cc:240] Negotiation successful
0810 01:41:05.962663 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":29,"thread_start_us":110,"threads_started":1}
I20260810 01:41:05.963639 25409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.956812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:42453 (local address 127.0.0.1:58548)
0810 01:41:05.957914 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:05.957929 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:05.958009 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:05.959615 (+ 1606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:05.959618 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:05.959638 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:05.959714 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.959720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.961041 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.961045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.962179 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:05.962194 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.963263 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.963267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:05.963356 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.963379 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:41:05.963453 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 01:41:05.963516 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":961,"mutex_wait_us":22,"thread_start_us":107,"threads_started":1}
I20260810 01:41:05.964226 25412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:05.957384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58548 (local address 127.24.205.130:42453)
0810 01:41:05.959176 (+ 1792us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:05.959188 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:05.959210 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:41:05.959283 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:05.959288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:05.959460 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:05.959618 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:05.959830 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.960924 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.962319 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:05.963027 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:05.963166 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:05.963321 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:05.963921 (+ 600us) server_negotiation.cc:299] Negotiation successful
0810 01:41:05.964026 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1690,"thread_start_us":130,"threads_started":1}
I20260810 01:41:05.965557 24865 tablet_service.cc:1467] Processing CreateTablet for tablet 3b88fa48ac3e4c1081fe8de0697a19d6 (DEFAULT_TABLE table=test-table [id=12ad1a50321e4f0aa6c502359d2d93bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:05.966274 25265 tablet_service.cc:1467] Processing CreateTablet for tablet 3b88fa48ac3e4c1081fe8de0697a19d6 (DEFAULT_TABLE table=test-table [id=12ad1a50321e4f0aa6c502359d2d93bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:05.966801 24865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b88fa48ac3e4c1081fe8de0697a19d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:05.967207 25265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b88fa48ac3e4c1081fe8de0697a19d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:05.967087 25070 tablet_service.cc:1467] Processing CreateTablet for tablet 3b88fa48ac3e4c1081fe8de0697a19d6 (DEFAULT_TABLE table=test-table [id=12ad1a50321e4f0aa6c502359d2d93bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:05.968036 25070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b88fa48ac3e4c1081fe8de0697a19d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:05.973409 25414 tablet_bootstrap.cc:492] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Bootstrap starting.
I20260810 01:41:05.974401 25415 tablet_bootstrap.cc:492] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: Bootstrap starting.
I20260810 01:41:05.975613 25416 tablet_bootstrap.cc:492] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Bootstrap starting.
I20260810 01:41:05.976667 25415 tablet_bootstrap.cc:654] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:05.976775 25414 tablet_bootstrap.cc:654] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:05.977465 25416 tablet_bootstrap.cc:654] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:05.977603 25414 log.cc:824] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:05.977604 25415 log.cc:824] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:05.978330 25416 log.cc:824] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:05.979909 25414 tablet_bootstrap.cc:492] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: No bootstrap required, opened a new log
I20260810 01:41:05.980192 25414 ts_tablet_manager.cc:1397] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 01:41:05.980419 25416 tablet_bootstrap.cc:492] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: No bootstrap required, opened a new log
I20260810 01:41:05.980504 25415 tablet_bootstrap.cc:492] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: No bootstrap required, opened a new log
I20260810 01:41:05.980621 25416 ts_tablet_manager.cc:1397] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:41:05.980734 25415 ts_tablet_manager.cc:1397] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 01:41:05.984252 25416 raft_consensus.cc:348] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:05.984505 25416 raft_consensus.cc:374] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:05.984560 25416 raft_consensus.cc:729] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5e42e9872f4dd0aa4901ec1df8c700, State: Initialized, Role: FOLLOWER
I20260810 01:41:05.984606 25414 raft_consensus.cc:348] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:05.984606 25415 raft_consensus.cc:348] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:05.984872 25415 raft_consensus.cc:374] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:05.984872 25414 raft_consensus.cc:374] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:05.984933 25414 raft_consensus.cc:729] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a1dd4f4afeb4dac9a8390469fdec4c7, State: Initialized, Role: FOLLOWER
I20260810 01:41:05.984933 25415 raft_consensus.cc:729] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be1e3c6e734d43b0acae7843971f61e9, State: Initialized, Role: FOLLOWER
I20260810 01:41:05.985051 25416 consensus_queue.cc:260] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:05.985383 25415 consensus_queue.cc:260] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:05.985383 25414 consensus_queue.cc:260] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:05.985858 25166 heartbeater.cc:503] Master 127.24.205.190:46603 was elected leader, sending a full tablet report...
I20260810 01:41:05.986177 25416 ts_tablet_manager.cc:1428] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:41:05.986347 25414 ts_tablet_manager.cc:1428] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:41:05.986658 24972 heartbeater.cc:503] Master 127.24.205.190:46603 was elected leader, sending a full tablet report...
I20260810 01:41:05.986654 25383 heartbeater.cc:503] Master 127.24.205.190:46603 was elected leader, sending a full tablet report...
I20260810 01:41:05.987546 25415 ts_tablet_manager.cc:1428] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260810 01:41:06.018453 24973 tablet.cc:2369] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:41:06.085496 25422 raft_consensus.cc:482] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:06.085731 25422 raft_consensus.cc:504] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:06.087080 25422 leader_election.cc:288] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be1e3c6e734d43b0acae7843971f61e9 (127.24.205.129:36287), 5c5e42e9872f4dd0aa4901ec1df8c700 (127.24.205.130:42453)
I20260810 01:41:06.088876 25421 raft_consensus.cc:482] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:06.089039 25421 raft_consensus.cc:504] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:06.090224 25421 leader_election.cc:288] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a1dd4f4afeb4dac9a8390469fdec4c7 (127.24.205.131:40921), 5c5e42e9872f4dd0aa4901ec1df8c700 (127.24.205.130:42453)
I20260810 01:41:06.092352 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.087492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:46497 (local address 127.24.205.129:36287)
0810 01:41:06.087644 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:06.087650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:06.087667 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:41:06.087723 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:06.087726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:06.087774 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:06.087856 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:06.088238 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.088985 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.091058 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.091694 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.091799 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.091850 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:06.092124 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 01:41:06.092212 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":66}
I20260810 01:41:06.092404 25412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.087474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.131:51781 (local address 127.24.205.130:42453)
0810 01:41:06.087624 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:06.087628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:06.087936 (+ 308us) server_negotiation.cc:407] Connection header received
0810 01:41:06.088045 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:06.088049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:06.088118 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:06.088221 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:06.088516 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.089257 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.091020 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.091643 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.091753 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.091811 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:06.092192 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 01:41:06.092278 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 01:41:06.092716 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.087252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:36287 (local address 127.24.205.131:46497)
0810 01:41:06.087414 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:06.087430 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:06.087527 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:06.087891 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:06.087894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:06.087922 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:06.088107 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.088116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.089122 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.089125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.090611 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.090623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.091819 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.091822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.091952 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.091980 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 01:41:06.092475 (+ 495us) client_negotiation.cc:240] Negotiation successful
0810 01:41:06.092555 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":150}
I20260810 01:41:06.093130 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.087372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:42453 (local address 127.24.205.131:51781)
0810 01:41:06.087841 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:06.087857 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:06.087949 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:06.088234 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:06.088237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:06.088255 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:06.088401 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.088408 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.089367 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.089371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.090883 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.090892 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.091910 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.091913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.092012 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.092035 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:41:06.092889 (+ 854us) client_negotiation.cc:240] Negotiation successful
0810 01:41:06.092965 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":18,"thread_start_us":152,"threads_started":1}
I20260810 01:41:06.093413 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b88fa48ac3e4c1081fe8de0697a19d6" candidate_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be1e3c6e734d43b0acae7843971f61e9" is_pre_election: true
I20260810 01:41:06.093636 24900 raft_consensus.cc:2454] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a1dd4f4afeb4dac9a8390469fdec4c7 in term 0.
I20260810 01:41:06.094036 25099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b88fa48ac3e4c1081fe8de0697a19d6" candidate_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" is_pre_election: true
I20260810 01:41:06.094089 25203 leader_election.cc:302] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a1dd4f4afeb4dac9a8390469fdec4c7, be1e3c6e734d43b0acae7843971f61e9; no voters:
I20260810 01:41:06.094305 25099 raft_consensus.cc:2454] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a1dd4f4afeb4dac9a8390469fdec4c7 in term 0.
I20260810 01:41:06.094364 25422 raft_consensus.cc:2781] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:06.094437 25422 raft_consensus.cc:482] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:06.094477 25422 raft_consensus.cc:3037] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:06.095132 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.090466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:51621 (local address 127.24.205.131:40921)
0810 01:41:06.090778 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:06.090782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:06.090792 (+ 10us) server_negotiation.cc:407] Connection header received
0810 01:41:06.090823 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:06.090825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:06.090876 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:06.090945 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:06.091325 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.092163 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.093663 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.094205 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.094319 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.094369 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:06.094964 (+ 595us) server_negotiation.cc:299] Negotiation successful
0810 01:41:06.095025 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":309,"server-negotiator.queue_time_us":253}
I20260810 01:41:06.095153 25425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.090356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.131:40921 (local address 127.24.205.129:51621)
0810 01:41:06.090622 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:06.090638 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:06.090720 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:06.090971 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:06.090974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:06.090995 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:06.091202 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.091211 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.092279 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.092282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.093542 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.093565 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.094702 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.094706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.094804 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.094828 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:41:06.094945 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 01:41:06.095014 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":24,"thread_start_us":69,"threads_started":1}
I20260810 01:41:06.095798 25422 raft_consensus.cc:504] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:06.095877 25298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b88fa48ac3e4c1081fe8de0697a19d6" candidate_uuid: "be1e3c6e734d43b0acae7843971f61e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" is_pre_election: true
I20260810 01:41:06.096081 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.090703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.130:42453 (local address 127.24.205.129:52149)
0810 01:41:06.091996 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:06.092011 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:06.092124 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:06.092473 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:06.092476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:06.092495 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:06.092603 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.092609 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.093618 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.093621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.094733 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:06.094745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.095636 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.095640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:06.095740 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.095763 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:41:06.095846 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 01:41:06.095918 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1230,"thread_start_us":93,"threads_started":1}
I20260810 01:41:06.096107 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.090954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.205.129:52149 (local address 127.24.205.130:42453)
0810 01:41:06.092053 (+ 1099us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:06.092088 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:06.092103 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:41:06.092244 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:06.092248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:06.092289 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:06.092360 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:06.092741 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.093487 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.094872 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.095487 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.095629 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.095691 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:06.095884 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 01:41:06.095955 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1034,"thread_start_us":117,"threads_started":1}
I20260810 01:41:06.096141 25298 raft_consensus.cc:2379] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be1e3c6e734d43b0acae7843971f61e9 in current term 1: Already voted for candidate 8a1dd4f4afeb4dac9a8390469fdec4c7 in this term.
I20260810 01:41:06.096200 25422 leader_election.cc:288] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [CANDIDATE]: Term 1 election: Requested vote from peers be1e3c6e734d43b0acae7843971f61e9 (127.24.205.129:36287), 5c5e42e9872f4dd0aa4901ec1df8c700 (127.24.205.130:42453)
I20260810 01:41:06.096421 25099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b88fa48ac3e4c1081fe8de0697a19d6" candidate_uuid: "be1e3c6e734d43b0acae7843971f61e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" is_pre_election: true
I20260810 01:41:06.096539 25099 raft_consensus.cc:2454] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be1e3c6e734d43b0acae7843971f61e9 in term 0.
I20260810 01:41:06.096612 25097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b88fa48ac3e4c1081fe8de0697a19d6" candidate_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700"
I20260810 01:41:06.096709 25097 raft_consensus.cc:3037] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:06.096949 24796 leader_election.cc:302] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c5e42e9872f4dd0aa4901ec1df8c700, be1e3c6e734d43b0acae7843971f61e9; no voters:
I20260810 01:41:06.096963 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b88fa48ac3e4c1081fe8de0697a19d6" candidate_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be1e3c6e734d43b0acae7843971f61e9"
I20260810 01:41:06.097114 24900 raft_consensus.cc:3037] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:06.098037 25097 raft_consensus.cc:2454] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a1dd4f4afeb4dac9a8390469fdec4c7 in term 1.
I20260810 01:41:06.098354 25204 leader_election.cc:302] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c5e42e9872f4dd0aa4901ec1df8c700, 8a1dd4f4afeb4dac9a8390469fdec4c7; no voters:
I20260810 01:41:06.098456 24900 raft_consensus.cc:2454] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a1dd4f4afeb4dac9a8390469fdec4c7 in term 1.
I20260810 01:41:06.098537 25422 raft_consensus.cc:2781] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:06.098658 25421 raft_consensus.cc:2741] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 01:41:06.098778 25422 raft_consensus.cc:686] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 1 LEADER]: Becoming Leader. State: Replica: 8a1dd4f4afeb4dac9a8390469fdec4c7, State: Running, Role: LEADER
I20260810 01:41:06.099099 25422 consensus_queue.cc:237] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } }
I20260810 01:41:06.102173 24660 catalog_manager.cc:5495] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a1dd4f4afeb4dac9a8390469fdec4c7 (127.24.205.131). New cstate: current_term: 1 leader_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a1dd4f4afeb4dac9a8390469fdec4c7" member_type: VOTER last_known_addr { host: "127.24.205.131" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 } health_report { overall_health: UNKNOWN } } }
I20260810 01:41:06.116494 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.113373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51622 (local address 127.24.205.131:40921)
0810 01:41:06.113485 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:06.113488 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:06.113499 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:41:06.113629 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:06.113631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:06.113677 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:06.113759 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:06.113954 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.114434 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.115250 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:06.115457 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:06.115533 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:06.115783 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:06.116195 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:06.116286 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:06.116365 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 01:41:06.116404 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:41:06.121942 24900 raft_consensus.cc:1261] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 1 FOLLOWER]: Refusing update from remote peer 8a1dd4f4afeb4dac9a8390469fdec4c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:06.121942 25097 raft_consensus.cc:1261] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 1 FOLLOWER]: Refusing update from remote peer 8a1dd4f4afeb4dac9a8390469fdec4c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:06.122593 25422 consensus_queue.cc:1035] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be1e3c6e734d43b0acae7843971f61e9" member_type: VOTER last_known_addr { host: "127.24.205.129" port: 36287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:06.122810 25433 consensus_queue.cc:1035] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c5e42e9872f4dd0aa4901ec1df8c700" member_type: VOTER last_known_addr { host: "127.24.205.130" port: 42453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:06.129529 25437 mvcc.cc:205] Tried to move back new op lower bound from 7316791566828597248 to 7316791566744403968. Current Snapshot: MvccSnapshot[applied={T|T < 7316791566828597248}]
I20260810 01:41:06.131963 25438 mvcc.cc:205] Tried to move back new op lower bound from 7316791566828597248 to 7316791566744403968. Current Snapshot: MvccSnapshot[applied={T|T < 7316791566828597248}]
I20260810 01:41:06.138403 24660 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:06.138582 24660 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:06.140969 24660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c59c44fdb4b4b6ba7a6baf8e0e0ba45: Sending DeleteTablet for 3 replicas of tablet 3b88fa48ac3e4c1081fe8de0697a19d6
I20260810 01:41:06.141781 24865 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b88fa48ac3e4c1081fe8de0697a19d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:06 UTC) from {username='slave'} at 127.0.0.1:60212
I20260810 01:41:06.141964 25070 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b88fa48ac3e4c1081fe8de0697a19d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:06 UTC) from {username='slave'} at 127.0.0.1:58548
I20260810 01:41:06.141983 25265 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b88fa48ac3e4c1081fe8de0697a19d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:06 UTC) from {username='slave'} at 127.0.0.1:51614
I20260810 01:41:06.142408 25453 tablet_replica.cc:330] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: stopping tablet replica
I20260810 01:41:06.142421 25452 tablet_replica.cc:330] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9: stopping tablet replica
I20260810 01:41:06.142716 25452 raft_consensus.cc:2229] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:06.142716 25453 raft_consensus.cc:2229] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:06.143002 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 24769
I20260810 01:41:06.143008 25453 raft_consensus.cc:2258] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:06.143008 25452 raft_consensus.cc:2258] T 3b88fa48ac3e4c1081fe8de0697a19d6 P be1e3c6e734d43b0acae7843971f61e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:06.146306 25454 tablet_replica.cc:330] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: stopping tablet replica
I20260810 01:41:06.146587 25454 raft_consensus.cc:2229] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:41:06.146996 25454 raft_consensus.cc:2258] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:06.147436 25453 ts_tablet_manager.cc:1905] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:06.150452 25453 ts_tablet_manager.cc:1918] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:06.150560 25453 log.cc:1196] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-1/wal/wals/3b88fa48ac3e4c1081fe8de0697a19d6
I20260810 01:41:06.150894 25453 ts_tablet_manager.cc:1939] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 5c5e42e9872f4dd0aa4901ec1df8c700: Deleting consensus metadata
I20260810 01:41:06.151162 25454 ts_tablet_manager.cc:1905] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:06.152235 24638 catalog_manager.cc:4841] TS 5c5e42e9872f4dd0aa4901ec1df8c700 (127.24.205.130:42453): tablet 3b88fa48ac3e4c1081fe8de0697a19d6 (table test-table [id=12ad1a50321e4f0aa6c502359d2d93bb]) successfully deleted
I20260810 01:41:06.153707 25454 ts_tablet_manager.cc:1918] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:06.153820 25454 log.cc:1196] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Deleting WAL directory at /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786325801109519-25398-0/minicluster-data/ts-2/wal/wals/3b88fa48ac3e4c1081fe8de0697a19d6
I20260810 01:41:06.154114 25454 ts_tablet_manager.cc:1939] T 3b88fa48ac3e4c1081fe8de0697a19d6 P 8a1dd4f4afeb4dac9a8390469fdec4c7: Deleting consensus metadata
W20260810 01:41:06.154881 24637 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.205.129:36287 (error 108)
I20260810 01:41:06.155296 24638 catalog_manager.cc:4841] TS 8a1dd4f4afeb4dac9a8390469fdec4c7 (127.24.205.131:40921): tablet 3b88fa48ac3e4c1081fe8de0697a19d6 (table test-table [id=12ad1a50321e4f0aa6c502359d2d93bb]) successfully deleted
I20260810 01:41:06.155761 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 24976
I20260810 01:41:06.158830 25409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:06.155957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.129:36287 (local address 127.0.0.1:60218)
0810 01:41:06.158657 (+ 2700us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:06.158739 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.129:36287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2571}
W20260810 01:41:06.160254 24637 catalog_manager.cc:4584] TS be1e3c6e734d43b0acae7843971f61e9 (127.24.205.129:36287): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b88fa48ac3e4c1081fe8de0697a19d6: Network error: Client connection negotiation failed: client connection to 127.24.205.129:36287: connect: Connection refused (error 111)
I20260810 01:41:06.169035 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25172
I20260810 01:41:06.181891 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 24607
2026-08-10T01:41:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1160 ms)
[----------] 6 tests from EncryptionPolicyTest (11299 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:06 dist-test-slave-t3q3 krb5kdc[25461](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:06 dist-test-slave-t3q3 krb5kdc[25461](info): set up 2 sockets
Aug 10 01:41:06 dist-test-slave-t3q3 krb5kdc[25461](info): commencing operation
krb5kdc: starting...
W20260810 01:41:07.452852 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:07 dist-test-slave-t3q3 krb5kdc[25461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:07.591279 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44275
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:07.707075 25479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:07.707368 25479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:07.707448 25479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:07.711476 25479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:07.711571 25479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:07.711624 25479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:07.711685 25479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:07.711725 25479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:07.717079 25479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44275
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:07.718196 25479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:07.719262 25479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:41:07.728104 25479 server_base.cc:1034] running on GCE node
W20260810 01:41:07.728035 25485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:07.728122 25489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:07.728312 25486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:07.728946 25479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:07.730101 25479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:07.731271 25479 hybrid_clock.cc:648] HybridClock initialized: now 1786326067731243 us; error 42 us; skew 500 ppm
Aug 10 01:41:07 dist-test-slave-t3q3 krb5kdc[25461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326067, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:07.734251 25479 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:07.735157 25479 webserver.cc:460] Webserver started at http://127.0.0.1:46043/ using document root <none> and password file <none>
I20260810 01:41:07.735740 25479 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:07.735803 25479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:07.736038 25479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:07.738272 25479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "788708c3c91c47f68a75a60e557cf30c"
format_stamp: "Formatted at 2026-08-10 01:41:07 on dist-test-slave-t3q3"
server_key: "470243f774aa9f3194ab81313e37d6ef"
server_key_iv: "0d327d53a87d69bc5ab867b8dab70e29"
server_key_version: "encryptionkey@0"
I20260810 01:41:07.738860 25479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "788708c3c91c47f68a75a60e557cf30c"
format_stamp: "Formatted at 2026-08-10 01:41:07 on dist-test-slave-t3q3"
server_key: "470243f774aa9f3194ab81313e37d6ef"
server_key_iv: "0d327d53a87d69bc5ab867b8dab70e29"
server_key_version: "encryptionkey@0"
I20260810 01:41:07.742667 25479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:41:07.745155 25502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:07.746410 25479 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:07.746553 25479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "788708c3c91c47f68a75a60e557cf30c"
format_stamp: "Formatted at 2026-08-10 01:41:07 on dist-test-slave-t3q3"
server_key: "470243f774aa9f3194ab81313e37d6ef"
server_key_iv: "0d327d53a87d69bc5ab867b8dab70e29"
server_key_version: "encryptionkey@0"
I20260810 01:41:07.746680 25479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:07.760190 25479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:07.763065 25479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:07.763268 25479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:07.770268 25479 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44275
I20260810 01:41:07.770285 25586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44275 every 8 connection(s)
I20260810 01:41:07.771221 25479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:07.774227 25587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:07.778786 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25479
I20260810 01:41:07.778975 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:07.779294 25398 external_mini_cluster.cc:1428] Setting key 6d2869dd5e80b51bbe81ab1b141dfcc5
I20260810 01:41:07.779975 25587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c: Bootstrap starting.
I20260810 01:41:07.782289 25587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:07.783249 25587 log.cc:824] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:07.785611 25587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c: No bootstrap required, opened a new log
Aug 10 01:41:07 dist-test-slave-t3q3 krb5kdc[25461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:41:07.790212 25587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788708c3c91c47f68a75a60e557cf30c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44275 } }
I20260810 01:41:07.790503 25587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:07.790582 25587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788708c3c91c47f68a75a60e557cf30c, State: Initialized, Role: FOLLOWER
I20260810 01:41:07.791085 25587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788708c3c91c47f68a75a60e557cf30c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44275 } }
I20260810 01:41:07.791276 25587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:07.791370 25587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:07.791512 25587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:07.792510 25587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788708c3c91c47f68a75a60e557cf30c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44275 } }
I20260810 01:41:07.792927 25587 leader_election.cc:302] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 788708c3c91c47f68a75a60e557cf30c; no voters:
I20260810 01:41:07.793339 25587 leader_election.cc:288] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:07.793406 25594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:07.793622 25594 raft_consensus.cc:686] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [term 1 LEADER]: Becoming Leader. State: Replica: 788708c3c91c47f68a75a60e557cf30c, State: Running, Role: LEADER
I20260810 01:41:07.793932 25594 consensus_queue.cc:237] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788708c3c91c47f68a75a60e557cf30c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44275 } }
I20260810 01:41:07.794697 25587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:07.795552 25596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "788708c3c91c47f68a75a60e557cf30c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788708c3c91c47f68a75a60e557cf30c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44275 } } }
I20260810 01:41:07.795687 25596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:07.796036 25595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 788708c3c91c47f68a75a60e557cf30c. Latest consensus state: current_term: 1 leader_uuid: "788708c3c91c47f68a75a60e557cf30c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788708c3c91c47f68a75a60e557cf30c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44275 } } }
I20260810 01:41:07.796152 25595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:07.796253 25609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:07.796239 25592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:07.780864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51651 (local address 127.0.0.1:44275)
0810 01:41:07.781306 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:07.781323 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:07.781359 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:41:07.781992 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:07.782010 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:07.782384 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:07.782695 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:07.783728 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:07.785055 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:07.786284 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:07.786824 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:07.786972 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:07.790063 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:07.790070 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:07.790085 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:07.790112 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:07.792234 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:07.792790 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:07.792797 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:07.792804 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:07.792950 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:07.793487 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:07.793491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:07.793494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:07.794197 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:07.794443 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:07.794829 (+ 386us) server_negotiation.cc:299] Negotiation successful
0810 01:41:07.795087 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":155,"threads_started":1}
I20260810 01:41:07.799741 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:07.799903 25609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:07.806484 25609 catalog_manager.cc:1347] Generated new cluster ID: 4ad101c6253a420491a9f9ae08423ecb
I20260810 01:41:07.806574 25609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:07.810639 25592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:07.802039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34937 (local address 127.0.0.1:44275)
0810 01:41:07.802141 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:07.802147 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:07.802471 (+ 324us) server_negotiation.cc:407] Connection header received
0810 01:41:07.802577 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:07.802581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:07.802629 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:07.802718 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:07.803548 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:07.804395 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:07.805279 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:07.805539 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:07.805657 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:07.807242 (+ 1585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:07.807245 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:07.807248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:07.807280 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:07.808823 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:07.809313 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:07.809317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:07.809318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:07.809403 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:07.809747 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:07.809750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:07.809752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:07.809929 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:07.810089 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:07.810371 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 01:41:07.810467 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:41:07.834286 25609 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:07.835290 25609 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:07.841380 25609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 788708c3c91c47f68a75a60e557cf30c: Generated new TSK 0
I20260810 01:41:07.842085 25609 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:07.852252 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25479
W20260810 01:41:07.868803 25457 connection.cc:535] client connection to 127.0.0.1:44275 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44275): Connection reset by peer (error 104)
2026-08-10T01:41:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1669 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:07 dist-test-slave-t3q3 krb5kdc[25630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:07 dist-test-slave-t3q3 krb5kdc[25630](info): set up 2 sockets
Aug 10 01:41:07 dist-test-slave-t3q3 krb5kdc[25630](info): commencing operation
krb5kdc: starting...
W20260810 01:41:09.119323 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:09 dist-test-slave-t3q3 krb5kdc[25630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:09.253640 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46449
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:09.369952 25644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:09.370290 25644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:09.370374 25644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:09.374392 25644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:09.374491 25644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:09.374527 25644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:09.374568 25644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:09.374600 25644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:09.379866 25644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46449
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:09.380996 25644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:09.382057 25644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:09.390728 25654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:09.390687 25652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:09.390895 25644 server_base.cc:1034] running on GCE node
W20260810 01:41:09.390682 25651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:09.391675 25644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:09.392844 25644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:09.394044 25644 hybrid_clock.cc:648] HybridClock initialized: now 1786326069394013 us; error 43 us; skew 500 ppm
Aug 10 01:41:09 dist-test-slave-t3q3 krb5kdc[25630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326069, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:09.396957 25644 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:09.397780 25644 webserver.cc:460] Webserver started at http://127.0.0.1:38277/ using document root <none> and password file <none>
I20260810 01:41:09.398290 25644 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:09.398348 25644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:09.398515 25644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:09.400763 25644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "2966f712e1fa4c91810909fcf46f36f2"
format_stamp: "Formatted at 2026-08-10 01:41:09 on dist-test-slave-t3q3"
server_key: "bbafcb08ca20542d0f73e8635ad9b6a3"
server_key_iv: "95dbd046df58998b33969c867a14659a"
server_key_version: "encryptionkey@0"
I20260810 01:41:09.401312 25644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "2966f712e1fa4c91810909fcf46f36f2"
format_stamp: "Formatted at 2026-08-10 01:41:09 on dist-test-slave-t3q3"
server_key: "bbafcb08ca20542d0f73e8635ad9b6a3"
server_key_iv: "95dbd046df58998b33969c867a14659a"
server_key_version: "encryptionkey@0"
I20260810 01:41:09.405014 25644 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:09.407393 25664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:09.408666 25644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:09.408766 25644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "2966f712e1fa4c91810909fcf46f36f2"
format_stamp: "Formatted at 2026-08-10 01:41:09 on dist-test-slave-t3q3"
server_key: "bbafcb08ca20542d0f73e8635ad9b6a3"
server_key_iv: "95dbd046df58998b33969c867a14659a"
server_key_version: "encryptionkey@0"
I20260810 01:41:09.408849 25644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:09.421608 25644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:09.424340 25644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:09.424490 25644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:09.431454 25644 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46449
I20260810 01:41:09.431475 25752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46449 every 8 connection(s)
I20260810 01:41:09.432447 25644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:09.435200 25753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:09.440876 25753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2: Bootstrap starting.
I20260810 01:41:09.441022 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25644
I20260810 01:41:09.441157 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:09.441483 25398 external_mini_cluster.cc:1428] Setting key 9185e122e00a7e072559c24970f39c89
I20260810 01:41:09.443719 25753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:09.444577 25753 log.cc:824] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:09.446493 25753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2: No bootstrap required, opened a new log
I20260810 01:41:09.450044 25753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2966f712e1fa4c91810909fcf46f36f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260810 01:41:09.450361 25753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:09.450446 25753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2966f712e1fa4c91810909fcf46f36f2, State: Initialized, Role: FOLLOWER
I20260810 01:41:09.450979 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:09.442903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33671 (local address 127.0.0.1:46449)
0810 01:41:09.443357 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:09.443381 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:09.443419 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:41:09.444194 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:09.444213 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:09.444570 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:09.444946 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:09.445381 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:09.446367 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:09.447327 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:09.447824 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:09.448014 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:09.449153 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:09.449158 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:09.449171 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:09.449564 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:09.449620 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:09.449643 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:09.449786 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:09.449976 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 01:41:09.450117 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":138,"threads_started":1}
I20260810 01:41:09.450949 25753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2966f712e1fa4c91810909fcf46f36f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260810 01:41:09.451116 25753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:09.451205 25753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:09.451309 25753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:09.452380 25753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2966f712e1fa4c91810909fcf46f36f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260810 01:41:09.452732 25753 leader_election.cc:302] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2966f712e1fa4c91810909fcf46f36f2; no voters:
I20260810 01:41:09.453099 25753 leader_election.cc:288] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:09.453162 25760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:09.453367 25760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [term 1 LEADER]: Becoming Leader. State: Replica: 2966f712e1fa4c91810909fcf46f36f2, State: Running, Role: LEADER
I20260810 01:41:09.453725 25760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2966f712e1fa4c91810909fcf46f36f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } }
I20260810 01:41:09.454131 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:09.454392 25753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:09.455425 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2966f712e1fa4c91810909fcf46f36f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2966f712e1fa4c91810909fcf46f36f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } } }
I20260810 01:41:09.455856 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:09.455749 25762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2966f712e1fa4c91810909fcf46f36f2. Latest consensus state: current_term: 1 leader_uuid: "2966f712e1fa4c91810909fcf46f36f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2966f712e1fa4c91810909fcf46f36f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46449 } } }
I20260810 01:41:09.456255 25762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:09.456385 25780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:09.459304 25780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:09.462215 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:09.457509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58299 (local address 127.0.0.1:46449)
0810 01:41:09.457634 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:09.457638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:09.457811 (+ 173us) server_negotiation.cc:407] Connection header received
0810 01:41:09.457918 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:09.457921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:09.457967 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:09.458059 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:09.458353 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:09.459136 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:09.460286 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:09.460635 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:09.460756 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:09.461759 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:09.461765 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:09.461769 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:09.461783 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:09.461813 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:09.461827 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:09.461927 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:09.462040 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 01:41:09.462075 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:41:09.468025 25780 catalog_manager.cc:1347] Generated new cluster ID: 3ebbfd6169d743cfad1729c65f012d43
I20260810 01:41:09.468118 25780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:09.479784 25780 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:09.481055 25780 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:09.493099 25780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2966f712e1fa4c91810909fcf46f36f2: Generated new TSK 0
I20260810 01:41:09.493847 25780 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:09.501525 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25644
W20260810 01:41:09.519806 25628 connection.cc:535] client connection to 127.0.0.1:46449 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46449): Connection reset by peer (error 104)
2026-08-10T01:41:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1651 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:09 dist-test-slave-t3q3 krb5kdc[25797](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:09 dist-test-slave-t3q3 krb5kdc[25797](info): set up 2 sockets
Aug 10 01:41:09 dist-test-slave-t3q3 krb5kdc[25797](info): commencing operation
krb5kdc: starting...
W20260810 01:41:10.784322 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:10 dist-test-slave-t3q3 krb5kdc[25797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:10.913307 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39369
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:11.030128 25814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:11.030431 25814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:11.030505 25814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:11.034497 25814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:11.034595 25814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:11.034637 25814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:11.034696 25814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:11.034737 25814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:11.039876 25814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39369
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:11.040930 25814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:11.042014 25814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:11.050704 25827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:11.050717 25823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:11.050717 25822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:11.051069 25814 server_base.cc:1034] running on GCE node
I20260810 01:41:11.051654 25814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:11.052832 25814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:11.054026 25814 hybrid_clock.cc:648] HybridClock initialized: now 1786326071054017 us; error 32 us; skew 500 ppm
Aug 10 01:41:11 dist-test-slave-t3q3 krb5kdc[25797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326071, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:11.060340 25814 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:11.061273 25814 webserver.cc:460] Webserver started at http://127.0.0.1:46517/ using document root <none> and password file <none>
I20260810 01:41:11.061823 25814 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:11.061885 25814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:11.062063 25814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:11.064220 25814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "2aff6ee680f64dae8fafd5059e2734a4"
format_stamp: "Formatted at 2026-08-10 01:41:11 on dist-test-slave-t3q3"
server_key: "2ee467f92ed53676e714059231ba5659"
server_key_iv: "180c47c810db906ac03e265f329ebb06"
server_key_version: "encryptionkey@0"
I20260810 01:41:11.064769 25814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "2aff6ee680f64dae8fafd5059e2734a4"
format_stamp: "Formatted at 2026-08-10 01:41:11 on dist-test-slave-t3q3"
server_key: "2ee467f92ed53676e714059231ba5659"
server_key_iv: "180c47c810db906ac03e265f329ebb06"
server_key_version: "encryptionkey@0"
I20260810 01:41:11.068646 25814 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:41:11.071178 25839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:11.072598 25814 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:11.072705 25814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "2aff6ee680f64dae8fafd5059e2734a4"
format_stamp: "Formatted at 2026-08-10 01:41:11 on dist-test-slave-t3q3"
server_key: "2ee467f92ed53676e714059231ba5659"
server_key_iv: "180c47c810db906ac03e265f329ebb06"
server_key_version: "encryptionkey@0"
I20260810 01:41:11.072795 25814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:11.077368 25814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:11.080650 25814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:11.080798 25814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:11.088335 25814 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39369
I20260810 01:41:11.088364 25921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39369 every 8 connection(s)
I20260810 01:41:11.089267 25814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:11.090297 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25814
I20260810 01:41:11.090464 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:11.090834 25398 external_mini_cluster.cc:1428] Setting key 04ce4dd304ff1c5ccd3e2fb81b907c73
I20260810 01:41:11.093065 25922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:11.096621 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:11.092645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53097 (local address 127.0.0.1:39369)
0810 01:41:11.093205 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:11.093224 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:11.093261 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:41:11.093902 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:11.093918 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:11.094207 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:11.094551 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:11.095382 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:11.095386 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:11.095398 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:11.095409 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:11.095462 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:11.095481 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:11.095633 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:11.095705 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 01:41:11.095863 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":151,"threads_started":1}
I20260810 01:41:11.099612 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:11.099614 25922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4: Bootstrap starting.
I20260810 01:41:11.101929 25922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:11.102727 25922 log.cc:824] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:11.103683 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:11.101789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34343 (local address 127.0.0.1:39369)
0810 01:41:11.101925 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:11.101930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:11.102083 (+ 153us) server_negotiation.cc:407] Connection header received
0810 01:41:11.102253 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:11.102256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:11.102287 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:11.102371 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:11.103114 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:11.103119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:11.103121 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:11.103134 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:11.103162 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:11.103180 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:11.103252 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:11.103384 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 01:41:11.103415 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:41:11.105050 25922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4: No bootstrap required, opened a new log
I20260810 01:41:11.108520 25922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aff6ee680f64dae8fafd5059e2734a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39369 } }
I20260810 01:41:11.108767 25922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:11.108860 25922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aff6ee680f64dae8fafd5059e2734a4, State: Initialized, Role: FOLLOWER
I20260810 01:41:11.109282 25922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aff6ee680f64dae8fafd5059e2734a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39369 } }
I20260810 01:41:11.109438 25922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:11.109529 25922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:11.109654 25922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:11.110538 25922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aff6ee680f64dae8fafd5059e2734a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39369 } }
I20260810 01:41:11.110886 25922 leader_election.cc:302] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2aff6ee680f64dae8fafd5059e2734a4; no voters:
I20260810 01:41:11.111245 25922 leader_election.cc:288] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:11.111353 25938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:11.111600 25938 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [term 1 LEADER]: Becoming Leader. State: Replica: 2aff6ee680f64dae8fafd5059e2734a4, State: Running, Role: LEADER
I20260810 01:41:11.111896 25938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aff6ee680f64dae8fafd5059e2734a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39369 } }
I20260810 01:41:11.112481 25922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:11.113765 25942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2aff6ee680f64dae8fafd5059e2734a4. Latest consensus state: current_term: 1 leader_uuid: "2aff6ee680f64dae8fafd5059e2734a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aff6ee680f64dae8fafd5059e2734a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39369 } } }
I20260810 01:41:11.113914 25942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:11.113773 25940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2aff6ee680f64dae8fafd5059e2734a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aff6ee680f64dae8fafd5059e2734a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39369 } } }
I20260810 01:41:11.114151 25940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:11.114328 25950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:11.117791 25950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:11.123452 25950 catalog_manager.cc:1347] Generated new cluster ID: 180bc22e6de7425e8eb314df2c529f91
I20260810 01:41:11.123523 25950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:11.147743 25950 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:11.148147 25950 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:11.152920 25950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2aff6ee680f64dae8fafd5059e2734a4: Generated new TSK 0
I20260810 01:41:11.153664 25950 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:11.157511 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25814
2026-08-10T01:41:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1656 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:11 dist-test-slave-t3q3 krb5kdc[25965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:11 dist-test-slave-t3q3 krb5kdc[25965](info): set up 2 sockets
Aug 10 01:41:11 dist-test-slave-t3q3 krb5kdc[25965](info): commencing operation
krb5kdc: starting...
W20260810 01:41:12.438402 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:12 dist-test-slave-t3q3 krb5kdc[25965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:12.575870 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46183
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:12.690055 25985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:12.690341 25985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:12.690442 25985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:12.694577 25985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:12.694640 25985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:12.694660 25985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:12.694677 25985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:12.694725 25985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:12.699954 25985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:12.701051 25985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:12.702154 25985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:12.711107 25993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:12.711261 25992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:12.711107 25996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:12.711505 25985 server_base.cc:1034] running on GCE node
I20260810 01:41:12.712021 25985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:12.713121 25985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:12.714321 25985 hybrid_clock.cc:648] HybridClock initialized: now 1786326072714311 us; error 33 us; skew 500 ppm
Aug 10 01:41:12 dist-test-slave-t3q3 krb5kdc[25965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326072, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:12.717789 25985 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:12.718904 25985 webserver.cc:460] Webserver started at http://127.0.0.1:41801/ using document root <none> and password file <none>
I20260810 01:41:12.719482 25985 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:12.719545 25985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:12.719713 25985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:12.721753 25985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "484c524bc46649fb82428ef1a43ae49c"
format_stamp: "Formatted at 2026-08-10 01:41:12 on dist-test-slave-t3q3"
server_key: "5ca5b05f6737e9b7bcae7359e2741896"
server_key_iv: "ccb499ff85f2eab7c46bd02dbb3188c0"
server_key_version: "encryptionkey@0"
I20260810 01:41:12.722272 25985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "484c524bc46649fb82428ef1a43ae49c"
format_stamp: "Formatted at 2026-08-10 01:41:12 on dist-test-slave-t3q3"
server_key: "5ca5b05f6737e9b7bcae7359e2741896"
server_key_iv: "ccb499ff85f2eab7c46bd02dbb3188c0"
server_key_version: "encryptionkey@0"
I20260810 01:41:12.726118 25985 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 01:41:12.728672 26005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:12.730111 25985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:12.730258 25985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "484c524bc46649fb82428ef1a43ae49c"
format_stamp: "Formatted at 2026-08-10 01:41:12 on dist-test-slave-t3q3"
server_key: "5ca5b05f6737e9b7bcae7359e2741896"
server_key_iv: "ccb499ff85f2eab7c46bd02dbb3188c0"
server_key_version: "encryptionkey@0"
I20260810 01:41:12.730388 25985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:12.746052 25985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:12.749070 25985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:12.749279 25985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:12.756253 25985 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46183
I20260810 01:41:12.756315 26090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46183 every 8 connection(s)
I20260810 01:41:12.757282 25985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:12.760181 26091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:12.760429 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 25985
I20260810 01:41:12.760582 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:12.760885 25398 external_mini_cluster.cc:1428] Setting key 768f9a754d1dc39d96845973c85e32bc
I20260810 01:41:12.767383 26091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c: Bootstrap starting.
I20260810 01:41:12.770040 26091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c: Neither blocks nor log segments found. Creating new log.
Aug 10 01:41:12 dist-test-slave-t3q3 krb5kdc[25965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:41:12.770961 26091 log.cc:824] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:12.773080 26091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c: No bootstrap required, opened a new log
I20260810 01:41:12.775974 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:12.762342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59699 (local address 127.0.0.1:46183)
0810 01:41:12.762759 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:12.762779 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:12.762823 (+ 44us) server_negotiation.cc:407] Connection header received
0810 01:41:12.763609 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:12.763634 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:12.764065 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:12.764455 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:12.765167 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:12.766681 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:12.767546 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:12.768235 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:12.768393 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:12.771141 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:12.771147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:12.771166 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:12.771193 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:12.772889 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:12.773410 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:12.773415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:12.773420 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:12.773531 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:12.773838 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:12.773840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:12.773841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:12.774353 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:12.774496 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:12.774835 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 01:41:12.775173 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":116,"threads_started":1}
I20260810 01:41:12.777393 26091 raft_consensus.cc:348] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484c524bc46649fb82428ef1a43ae49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46183 } }
I20260810 01:41:12.777660 26091 raft_consensus.cc:374] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:12.777758 26091 raft_consensus.cc:729] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 484c524bc46649fb82428ef1a43ae49c, State: Initialized, Role: FOLLOWER
I20260810 01:41:12.778200 26091 consensus_queue.cc:260] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484c524bc46649fb82428ef1a43ae49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46183 } }
I20260810 01:41:12.778366 26091 raft_consensus.cc:388] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:12.778455 26091 raft_consensus.cc:482] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:12.778576 26091 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:12.779027 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:12.779597 26091 raft_consensus.cc:504] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484c524bc46649fb82428ef1a43ae49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46183 } }
I20260810 01:41:12.779942 26091 leader_election.cc:302] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 484c524bc46649fb82428ef1a43ae49c; no voters:
I20260810 01:41:12.780315 26091 leader_election.cc:288] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:12.780429 26102 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:12.780642 26102 raft_consensus.cc:686] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [term 1 LEADER]: Becoming Leader. State: Replica: 484c524bc46649fb82428ef1a43ae49c, State: Running, Role: LEADER
I20260810 01:41:12.780978 26102 consensus_queue.cc:237] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484c524bc46649fb82428ef1a43ae49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46183 } }
I20260810 01:41:12.781706 26091 sys_catalog.cc:564] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:12.782245 26102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 484c524bc46649fb82428ef1a43ae49c. Latest consensus state: current_term: 1 leader_uuid: "484c524bc46649fb82428ef1a43ae49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484c524bc46649fb82428ef1a43ae49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46183 } } }
I20260810 01:41:12.782370 26102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:12.782835 26106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "484c524bc46649fb82428ef1a43ae49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484c524bc46649fb82428ef1a43ae49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46183 } } }
I20260810 01:41:12.782985 26106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:12.783987 26114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:12.787091 26114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:12.791235 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:12.781174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54799 (local address 127.0.0.1:46183)
0810 01:41:12.781277 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:12.781281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:12.781575 (+ 294us) server_negotiation.cc:407] Connection header received
0810 01:41:12.781676 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:12.781679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:12.781725 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:12.781828 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:12.784526 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:12.785071 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:12.785921 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:12.786164 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:12.786277 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:12.787717 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:12.787721 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:12.787724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:12.787756 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:12.789346 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:12.789854 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:12.789857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:12.789859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:12.789949 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:12.790268 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:12.790271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:12.790272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:12.790484 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:12.790611 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:12.790913 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 01:41:12.791032 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:41:12.793869 26114 catalog_manager.cc:1347] Generated new cluster ID: 599a43a2e30f42b99ff300baa94038f6
I20260810 01:41:12.793936 26114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:12.807186 26114 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:12.808478 26114 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:12.815745 26114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 484c524bc46649fb82428ef1a43ae49c: Generated new TSK 0
I20260810 01:41:12.816517 26114 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:12.825414 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 25985
2026-08-10T01:41:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1664 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:12 dist-test-slave-t3q3 krb5kdc[26143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:12 dist-test-slave-t3q3 krb5kdc[26143](info): set up 2 sockets
Aug 10 01:41:12 dist-test-slave-t3q3 krb5kdc[26143](info): commencing operation
krb5kdc: starting...
W20260810 01:41:14.128033 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:14 dist-test-slave-t3q3 krb5kdc[26143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:14.254992 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35039
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:14.369220 26166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:14.369660 26166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:14.369724 26166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:14.377441 26166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:14.377535 26166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:14.377565 26166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:14.377588 26166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:14.377617 26166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:14.388463 26166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:14.390012 26166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:14.391685 26166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:14.405246 26174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:14.405251 26179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:14.405251 26172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:14.405504 26166 server_base.cc:1034] running on GCE node
I20260810 01:41:14.406351 26166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:14.407917 26166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:14.409056 26166 hybrid_clock.cc:648] HybridClock initialized: now 1786326074409032 us; error 43 us; skew 500 ppm
Aug 10 01:41:14 dist-test-slave-t3q3 krb5kdc[26143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326074, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:14.413650 26166 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:14.414667 26166 webserver.cc:460] Webserver started at http://127.0.0.1:43945/ using document root <none> and password file <none>
I20260810 01:41:14.415221 26166 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:14.415292 26166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:14.415463 26166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:14.417660 26166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "e1b29f686a304a0fac7d525fa471a4dd"
format_stamp: "Formatted at 2026-08-10 01:41:14 on dist-test-slave-t3q3"
server_key: "773d6095552c7179b22382df1c8bfb1e"
server_key_iv: "419751944284725e8b271da4b78d093c"
server_key_version: "encryptionkey@0"
I20260810 01:41:14.418336 26166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "e1b29f686a304a0fac7d525fa471a4dd"
format_stamp: "Formatted at 2026-08-10 01:41:14 on dist-test-slave-t3q3"
server_key: "773d6095552c7179b22382df1c8bfb1e"
server_key_iv: "419751944284725e8b271da4b78d093c"
server_key_version: "encryptionkey@0"
I20260810 01:41:14.423420 26166 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260810 01:41:14.425860 26194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:14.427098 26166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 01:41:14.427201 26166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "e1b29f686a304a0fac7d525fa471a4dd"
format_stamp: "Formatted at 2026-08-10 01:41:14 on dist-test-slave-t3q3"
server_key: "773d6095552c7179b22382df1c8bfb1e"
server_key_iv: "419751944284725e8b271da4b78d093c"
server_key_version: "encryptionkey@0"
I20260810 01:41:14.427286 26166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:14.438091 26166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:14.441289 26166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:14.441452 26166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:14.449301 26166 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35039
I20260810 01:41:14.449314 26276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35039 every 8 connection(s)
I20260810 01:41:14.450291 26166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:14.451902 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26166
I20260810 01:41:14.452076 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:14.452396 25398 external_mini_cluster.cc:1428] Setting key 5d174abf7f065b539809a8f536a1d134
I20260810 01:41:14.453657 26277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:14.460139 26277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd: Bootstrap starting.
I20260810 01:41:14.462008 26281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:14.453834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53629 (local address 127.0.0.1:35039)
0810 01:41:14.454269 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:14.454285 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:14.454321 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:41:14.455024 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:14.455041 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:14.455384 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:14.455713 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:14.456242 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:14.457297 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:14.458535 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:14.459022 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:14.459144 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:14.460121 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:14.460131 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:14.460153 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:14.460605 (+ 452us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:14.460663 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:14.460687 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:14.460767 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:14.460993 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 01:41:14.461280 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":151,"threads_started":1}
I20260810 01:41:14.462560 26277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:14.463402 26277 log.cc:824] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:14.465049 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:14.465569 26277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd: No bootstrap required, opened a new log
I20260810 01:41:14.469188 26277 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b29f686a304a0fac7d525fa471a4dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260810 01:41:14.469453 26277 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:14.469515 26277 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b29f686a304a0fac7d525fa471a4dd, State: Initialized, Role: FOLLOWER
I20260810 01:41:14.469962 26277 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b29f686a304a0fac7d525fa471a4dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260810 01:41:14.470093 26277 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:14.470189 26277 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:14.470319 26277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:14.471472 26281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:14.467031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42193 (local address 127.0.0.1:35039)
0810 01:41:14.467166 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:14.467170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:14.467366 (+ 196us) server_negotiation.cc:407] Connection header received
0810 01:41:14.467480 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:14.467482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:14.467518 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:14.467580 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:14.467861 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:14.468744 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:14.469847 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:14.470080 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:14.470184 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:14.471052 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:14.471055 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:14.471058 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:14.471076 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:14.471098 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:14.471109 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:14.471190 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:14.471296 (+ 106us) server_negotiation.cc:299] Negotiation successful
0810 01:41:14.471342 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:41:14.471424 26277 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b29f686a304a0fac7d525fa471a4dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260810 01:41:14.471865 26277 leader_election.cc:302] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1b29f686a304a0fac7d525fa471a4dd; no voters:
I20260810 01:41:14.472236 26277 leader_election.cc:288] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:14.472340 26291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:14.472595 26291 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [term 1 LEADER]: Becoming Leader. State: Replica: e1b29f686a304a0fac7d525fa471a4dd, State: Running, Role: LEADER
I20260810 01:41:14.472898 26291 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b29f686a304a0fac7d525fa471a4dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } }
I20260810 01:41:14.473460 26277 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:14.474532 26293 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1b29f686a304a0fac7d525fa471a4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b29f686a304a0fac7d525fa471a4dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } } }
I20260810 01:41:14.474664 26293 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:14.474996 26292 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1b29f686a304a0fac7d525fa471a4dd. Latest consensus state: current_term: 1 leader_uuid: "e1b29f686a304a0fac7d525fa471a4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b29f686a304a0fac7d525fa471a4dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35039 } } }
I20260810 01:41:14.475090 26304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:14.475116 26292 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:14.478371 26304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:14.484176 26304 catalog_manager.cc:1347] Generated new cluster ID: 966336d20a874e0c938687aff90e482e
I20260810 01:41:14.484238 26304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:14.492740 26304 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:14.493923 26304 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:14.503829 26304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1b29f686a304a0fac7d525fa471a4dd: Generated new TSK 0
I20260810 01:41:14.504601 26304 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:14.509210 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26166
2026-08-10T01:41:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1682 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:14 dist-test-slave-t3q3 krb5kdc[26322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:14 dist-test-slave-t3q3 krb5kdc[26322](info): set up 2 sockets
Aug 10 01:41:14 dist-test-slave-t3q3 krb5kdc[26322](info): commencing operation
krb5kdc: starting...
W20260810 01:41:15.768903 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:15 dist-test-slave-t3q3 krb5kdc[26322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:15.894855 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38315
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:16.010803 26343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:16.011071 26343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:16.011116 26343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:16.015214 26343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:16.015276 26343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:16.015295 26343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:16.015312 26343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:16.015327 26343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:16.020767 26343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:16.021836 26343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:16.022892 26343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:16.031550 26350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:16.031531 26354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:16.031592 26351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:16.031709 26343 server_base.cc:1034] running on GCE node
I20260810 01:41:16.032801 26343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:16.033948 26343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:16.035153 26343 hybrid_clock.cc:648] HybridClock initialized: now 1786326076035132 us; error 35 us; skew 500 ppm
Aug 10 01:41:16 dist-test-slave-t3q3 krb5kdc[26322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326076, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:16.038014 26343 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:16.038993 26343 webserver.cc:460] Webserver started at http://127.0.0.1:35829/ using document root <none> and password file <none>
I20260810 01:41:16.039529 26343 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:16.039593 26343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:16.039774 26343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:16.041962 26343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "a8cc604c0abb47e1b688bb9958b2367a"
format_stamp: "Formatted at 2026-08-10 01:41:16 on dist-test-slave-t3q3"
server_key: "6612ce2d68324afd8c2a7ad2231b3264"
server_key_iv: "5c2c8f2f68df540ba3449a43573d8abe"
server_key_version: "encryptionkey@0"
I20260810 01:41:16.042488 26343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "a8cc604c0abb47e1b688bb9958b2367a"
format_stamp: "Formatted at 2026-08-10 01:41:16 on dist-test-slave-t3q3"
server_key: "6612ce2d68324afd8c2a7ad2231b3264"
server_key_iv: "5c2c8f2f68df540ba3449a43573d8abe"
server_key_version: "encryptionkey@0"
I20260810 01:41:16.046310 26343 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:41:16.048909 26364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:16.050230 26343 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:16.050334 26343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "a8cc604c0abb47e1b688bb9958b2367a"
format_stamp: "Formatted at 2026-08-10 01:41:16 on dist-test-slave-t3q3"
server_key: "6612ce2d68324afd8c2a7ad2231b3264"
server_key_iv: "5c2c8f2f68df540ba3449a43573d8abe"
server_key_version: "encryptionkey@0"
I20260810 01:41:16.050424 26343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:16.055188 26343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:16.058451 26343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:16.058604 26343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:16.066080 26343 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38315
I20260810 01:41:16.066125 26449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38315 every 8 connection(s)
I20260810 01:41:16.067052 26343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:16.069824 26450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:16.071612 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26343
I20260810 01:41:16.071782 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:16.072118 25398 external_mini_cluster.cc:1428] Setting key 4c38e407421860d7a60050f80931184e
I20260810 01:41:16.076771 26450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a: Bootstrap starting.
I20260810 01:41:16.078981 26450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:16.079703 26450 log.cc:824] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:16.081871 26450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a: No bootstrap required, opened a new log
I20260810 01:41:16.082844 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:16.073625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49225 (local address 127.0.0.1:38315)
0810 01:41:16.074061 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:16.074080 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:16.074123 (+ 43us) server_negotiation.cc:407] Connection header received
0810 01:41:16.074948 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:16.074976 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:16.075337 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:16.075719 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:16.081268 (+ 5549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:16.081274 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:16.081291 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:16.081305 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:16.081372 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:16.081398 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:16.081515 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:16.081614 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 01:41:16.081791 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":115,"threads_started":1}
I20260810 01:41:16.085822 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:16.085897 26450 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8cc604c0abb47e1b688bb9958b2367a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38315 } }
I20260810 01:41:16.086158 26450 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:16.086220 26450 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8cc604c0abb47e1b688bb9958b2367a, State: Initialized, Role: FOLLOWER
I20260810 01:41:16.086700 26450 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8cc604c0abb47e1b688bb9958b2367a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38315 } }
I20260810 01:41:16.086876 26450 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:16.086936 26450 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:16.087036 26450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:16.088294 26450 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8cc604c0abb47e1b688bb9958b2367a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38315 } }
I20260810 01:41:16.088688 26450 leader_election.cc:302] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8cc604c0abb47e1b688bb9958b2367a; no voters:
I20260810 01:41:16.089082 26450 leader_election.cc:288] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:16.089152 26466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:16.089367 26466 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [term 1 LEADER]: Becoming Leader. State: Replica: a8cc604c0abb47e1b688bb9958b2367a, State: Running, Role: LEADER
I20260810 01:41:16.089660 26466 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8cc604c0abb47e1b688bb9958b2367a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38315 } }
I20260810 01:41:16.090147 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:16.088240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32769 (local address 127.0.0.1:38315)
0810 01:41:16.088377 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:16.088383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:16.088565 (+ 182us) server_negotiation.cc:407] Connection header received
0810 01:41:16.088664 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:16.088667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:16.088716 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:16.088801 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:16.089660 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:16.089664 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:16.089669 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:16.089681 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:16.089709 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:16.089723 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:16.089778 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:16.089987 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 01:41:16.090029 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:41:16.090404 26450 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:16.091588 26467 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8cc604c0abb47e1b688bb9958b2367a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8cc604c0abb47e1b688bb9958b2367a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38315 } } }
I20260810 01:41:16.091734 26467 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:16.092110 26469 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8cc604c0abb47e1b688bb9958b2367a. Latest consensus state: current_term: 1 leader_uuid: "a8cc604c0abb47e1b688bb9958b2367a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8cc604c0abb47e1b688bb9958b2367a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38315 } } }
I20260810 01:41:16.092206 26469 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:16.092320 26478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:16.095088 26478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:16.100276 26478 catalog_manager.cc:1347] Generated new cluster ID: 08df971963d84338aab43888c46497f0
I20260810 01:41:16.100348 26478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:16.111696 26478 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:16.112092 26478 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:16.121712 26478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8cc604c0abb47e1b688bb9958b2367a: Generated new TSK 0
I20260810 01:41:16.122566 26478 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:16.129473 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26343
2026-08-10T01:41:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1622 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:16 dist-test-slave-t3q3 krb5kdc[26499](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:16 dist-test-slave-t3q3 krb5kdc[26499](info): set up 2 sockets
Aug 10 01:41:16 dist-test-slave-t3q3 krb5kdc[26499](info): commencing operation
krb5kdc: starting...
W20260810 01:41:17.419461 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:17 dist-test-slave-t3q3 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:17.555095 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36849
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:17.667989 26518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:17.668341 26518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:17.668424 26518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:17.672394 26518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:17.672473 26518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:17.672509 26518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:17.672546 26518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:17.672583 26518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:17.677670 26518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:17.678678 26518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:17.679677 26518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:17.688145 26525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:17.688201 26524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:17.688145 26528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:17.688575 26518 server_base.cc:1034] running on GCE node
I20260810 01:41:17.689141 26518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:17.690215 26518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:17.691406 26518 hybrid_clock.cc:648] HybridClock initialized: now 1786326077691389 us; error 32 us; skew 500 ppm
Aug 10 01:41:17 dist-test-slave-t3q3 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326077, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:17.694110 26518 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:17.694958 26518 webserver.cc:460] Webserver started at http://127.0.0.1:40907/ using document root <none> and password file <none>
I20260810 01:41:17.695518 26518 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:17.695613 26518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:17.695852 26518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:17.697901 26518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "a477c174f5fe4c098a3815b1be062c93"
format_stamp: "Formatted at 2026-08-10 01:41:17 on dist-test-slave-t3q3"
server_key: "91161e7ff1fcddd2780c95c0d28bc0a9"
server_key_iv: "7dbff06af69c56b7d19ed7c6ca3dba7f"
server_key_version: "encryptionkey@0"
I20260810 01:41:17.698495 26518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "a477c174f5fe4c098a3815b1be062c93"
format_stamp: "Formatted at 2026-08-10 01:41:17 on dist-test-slave-t3q3"
server_key: "91161e7ff1fcddd2780c95c0d28bc0a9"
server_key_iv: "7dbff06af69c56b7d19ed7c6ca3dba7f"
server_key_version: "encryptionkey@0"
I20260810 01:41:17.702181 26518 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:41:17.704548 26543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:17.705722 26518 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:17.705868 26518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "a477c174f5fe4c098a3815b1be062c93"
format_stamp: "Formatted at 2026-08-10 01:41:17 on dist-test-slave-t3q3"
server_key: "91161e7ff1fcddd2780c95c0d28bc0a9"
server_key_iv: "7dbff06af69c56b7d19ed7c6ca3dba7f"
server_key_version: "encryptionkey@0"
I20260810 01:41:17.705979 26518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:17.718899 26518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:17.721827 26518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:17.722039 26518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:17.729465 26518 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36849
I20260810 01:41:17.729528 26626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36849 every 8 connection(s)
I20260810 01:41:17.730479 26518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:17.732362 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26518
I20260810 01:41:17.732507 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:17.732815 25398 external_mini_cluster.cc:1428] Setting key bb3c3455dbd6f7f85226bfeaf8a1ea83
I20260810 01:41:17.733706 26627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:17.740801 26627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93: Bootstrap starting.
I20260810 01:41:17.743222 26627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93: Neither blocks nor log segments found. Creating new log.
Aug 10 01:41:17 dist-test-slave-t3q3 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:41:17.744305 26627 log.cc:824] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:17.746560 26627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93: No bootstrap required, opened a new log
I20260810 01:41:17.749056 26630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:17.734245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:58555 (local address 127.0.0.1:36849)
0810 01:41:17.734648 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:17.734668 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:17.734711 (+ 43us) server_negotiation.cc:407] Connection header received
0810 01:41:17.735551 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:17.735575 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:17.735994 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:17.737403 (+ 1409us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:17.737814 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:17.739297 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:17.740251 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:17.740954 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:17.741128 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:17.744050 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:17.744056 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:17.744134 (+ 78us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:17.744168 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:17.746073 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:17.746671 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:17.746679 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:17.746691 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:17.746804 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:17.747173 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:17.747175 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:17.747176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:17.747547 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:17.747706 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:17.748039 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 01:41:17.748371 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":109,"threads_started":1}
I20260810 01:41:17.750530 26627 raft_consensus.cc:348] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a477c174f5fe4c098a3815b1be062c93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 01:41:17.750785 26627 raft_consensus.cc:374] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:17.750854 26627 raft_consensus.cc:729] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a477c174f5fe4c098a3815b1be062c93, State: Initialized, Role: FOLLOWER
I20260810 01:41:17.751335 26627 consensus_queue.cc:260] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a477c174f5fe4c098a3815b1be062c93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 01:41:17.751508 26627 raft_consensus.cc:388] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:17.751585 26627 raft_consensus.cc:482] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:17.751693 26627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:17.752041 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:17.752853 26627 raft_consensus.cc:504] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a477c174f5fe4c098a3815b1be062c93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 01:41:17.753244 26627 leader_election.cc:302] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a477c174f5fe4c098a3815b1be062c93; no voters:
I20260810 01:41:17.753618 26627 leader_election.cc:288] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:17.753705 26636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:17.753929 26636 raft_consensus.cc:686] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [term 1 LEADER]: Becoming Leader. State: Replica: a477c174f5fe4c098a3815b1be062c93, State: Running, Role: LEADER
I20260810 01:41:17.754261 26636 consensus_queue.cc:237] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a477c174f5fe4c098a3815b1be062c93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 01:41:17.754925 26627 sys_catalog.cc:564] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:17.756091 26639 sys_catalog.cc:455] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a477c174f5fe4c098a3815b1be062c93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a477c174f5fe4c098a3815b1be062c93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } } }
I20260810 01:41:17.756242 26639 sys_catalog.cc:458] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:17.756472 26639 sys_catalog.cc:455] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a477c174f5fe4c098a3815b1be062c93. Latest consensus state: current_term: 1 leader_uuid: "a477c174f5fe4c098a3815b1be062c93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a477c174f5fe4c098a3815b1be062c93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } } }
I20260810 01:41:17.756543 26639 sys_catalog.cc:458] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:17.756798 26654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:17.760463 26654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:17.764210 26630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:17.754367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:46801 (local address 127.0.0.1:36849)
0810 01:41:17.754472 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:17.754476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:17.754897 (+ 421us) server_negotiation.cc:407] Connection header received
0810 01:41:17.755073 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:17.755076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:17.755130 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:17.755216 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:17.756166 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:17.756961 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:17.758152 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:17.758481 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:17.758588 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:17.760331 (+ 1743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:17.760335 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:17.760338 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:17.760365 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:17.762091 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:17.762752 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:17.762755 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:17.762757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:17.762847 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:17.763238 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:17.763241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:17.763243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:17.763451 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:17.763595 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:17.763935 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 01:41:17.764030 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":32}
I20260810 01:41:17.766426 26654 catalog_manager.cc:1347] Generated new cluster ID: bda3154b5f9d42c598cb75a14e6411bc
I20260810 01:41:17.766499 26654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:17.778949 26654 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:17.780236 26654 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:17.792965 26654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a477c174f5fe4c098a3815b1be062c93: Generated new TSK 0
I20260810 01:41:17.793846 26654 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:17.801801 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26518
W20260810 01:41:17.815276 26497 connection.cc:535] client connection to 127.0.0.1:36849 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36849): Connection reset by peer (error 104)
2026-08-10T01:41:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1669 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:17 dist-test-slave-t3q3 krb5kdc[26678](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:17 dist-test-slave-t3q3 krb5kdc[26678](info): set up 2 sockets
Aug 10 01:41:17 dist-test-slave-t3q3 krb5kdc[26678](info): commencing operation
krb5kdc: starting...
W20260810 01:41:19.065088 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:19 dist-test-slave-t3q3 krb5kdc[26678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:19.195554 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35107
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:19.308929 26700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:19.309198 26700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:19.309240 26700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:19.313241 26700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:19.313304 26700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:19.313326 26700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:19.313342 26700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:19.313357 26700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:19.318688 26700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:19.319777 26700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:19.320938 26700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:19.330215 26707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:19.330426 26700 server_base.cc:1034] running on GCE node
W20260810 01:41:19.330219 26706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:19.330215 26709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:19.331285 26700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:19.332506 26700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:19.333669 26700 hybrid_clock.cc:648] HybridClock initialized: now 1786326079333636 us; error 49 us; skew 500 ppm
Aug 10 01:41:19 dist-test-slave-t3q3 krb5kdc[26678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326079, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:19.336948 26700 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:19.337862 26700 webserver.cc:460] Webserver started at http://127.0.0.1:39257/ using document root <none> and password file <none>
I20260810 01:41:19.338451 26700 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:19.338547 26700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:19.338802 26700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:19.340988 26700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "807af15100464a43ad3f13c3d390dfeb"
format_stamp: "Formatted at 2026-08-10 01:41:19 on dist-test-slave-t3q3"
server_key: "e2545687676a955d58fbf716f233e226"
server_key_iv: "790e9470bab83b4553a06e026d5b3cf7"
server_key_version: "encryptionkey@0"
I20260810 01:41:19.341557 26700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "807af15100464a43ad3f13c3d390dfeb"
format_stamp: "Formatted at 2026-08-10 01:41:19 on dist-test-slave-t3q3"
server_key: "e2545687676a955d58fbf716f233e226"
server_key_iv: "790e9470bab83b4553a06e026d5b3cf7"
server_key_version: "encryptionkey@0"
I20260810 01:41:19.345283 26700 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:41:19.347766 26720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:19.349066 26700 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:19.349216 26700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "807af15100464a43ad3f13c3d390dfeb"
format_stamp: "Formatted at 2026-08-10 01:41:19 on dist-test-slave-t3q3"
server_key: "e2545687676a955d58fbf716f233e226"
server_key_iv: "790e9470bab83b4553a06e026d5b3cf7"
server_key_version: "encryptionkey@0"
I20260810 01:41:19.349329 26700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:19.363340 26700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:19.366822 26700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:19.367060 26700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:19.374380 26700 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35107
I20260810 01:41:19.374447 26815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35107 every 8 connection(s)
I20260810 01:41:19.375394 26700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:19.378346 26826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:19.381947 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26700
I20260810 01:41:19.382103 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:19.382413 25398 external_mini_cluster.cc:1428] Setting key c87e7cad4d40bf7772d1dd3cd819c80c
I20260810 01:41:19.384895 26826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb: Bootstrap starting.
I20260810 01:41:19.387398 26826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:19.388311 26826 log.cc:824] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:19.390475 26826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb: No bootstrap required, opened a new log
I20260810 01:41:19.392016 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:19.383827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:46251 (local address 127.0.0.1:35107)
0810 01:41:19.384416 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:19.384432 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:19.384467 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:41:19.385153 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:19.385173 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:19.385536 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:19.385874 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:19.386303 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:19.387308 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:19.388366 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:19.388887 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:19.389057 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:19.389988 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:19.389997 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:19.390015 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:19.390465 (+ 450us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:19.390520 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:19.390544 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:19.390698 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:19.391060 (+ 362us) server_negotiation.cc:299] Negotiation successful
0810 01:41:19.391265 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":287,"threads_started":1}
I20260810 01:41:19.394569 26826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807af15100464a43ad3f13c3d390dfeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35107 } }
I20260810 01:41:19.394894 26826 raft_consensus.cc:374] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:19.394968 26826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807af15100464a43ad3f13c3d390dfeb, State: Initialized, Role: FOLLOWER
I20260810 01:41:19.395498 26826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807af15100464a43ad3f13c3d390dfeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35107 } }
I20260810 01:41:19.395717 26826 raft_consensus.cc:388] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:19.395797 26826 raft_consensus.cc:482] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:19.395826 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:19.395874 26826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:19.396916 26826 raft_consensus.cc:504] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807af15100464a43ad3f13c3d390dfeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35107 } }
I20260810 01:41:19.397307 26826 leader_election.cc:302] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 807af15100464a43ad3f13c3d390dfeb; no voters:
I20260810 01:41:19.397647 26826 leader_election.cc:288] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:19.397722 26843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:19.397991 26843 raft_consensus.cc:686] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [term 1 LEADER]: Becoming Leader. State: Replica: 807af15100464a43ad3f13c3d390dfeb, State: Running, Role: LEADER
I20260810 01:41:19.398406 26843 consensus_queue.cc:237] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807af15100464a43ad3f13c3d390dfeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35107 } }
I20260810 01:41:19.399112 26826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:19.399749 26843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "807af15100464a43ad3f13c3d390dfeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807af15100464a43ad3f13c3d390dfeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35107 } } }
I20260810 01:41:19.399957 26843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:19.400290 26843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 807af15100464a43ad3f13c3d390dfeb. Latest consensus state: current_term: 1 leader_uuid: "807af15100464a43ad3f13c3d390dfeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807af15100464a43ad3f13c3d390dfeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35107 } } }
I20260810 01:41:19.400452 26843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:19.402093 26856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:19.402952 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:19.398050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:40273 (local address 127.0.0.1:35107)
0810 01:41:19.398166 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:19.398171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:19.398434 (+ 263us) server_negotiation.cc:407] Connection header received
0810 01:41:19.398641 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:19.398644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:19.398688 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:19.398775 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:19.399052 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:19.399699 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:19.400885 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:19.401255 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:19.401359 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:19.402327 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:19.402330 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:19.402359 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:19.402378 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:19.402413 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:19.402432 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:19.402542 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:19.402757 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 01:41:19.402796 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:41:19.405669 26856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:19.411377 26856 catalog_manager.cc:1347] Generated new cluster ID: 3d9531ac2f384ef4ae4c0a121e7d8820
I20260810 01:41:19.411443 26856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:19.426095 26856 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:19.427059 26856 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:19.433527 26856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 807af15100464a43ad3f13c3d390dfeb: Generated new TSK 0
I20260810 01:41:19.434221 26856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:19.440070 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26700
W20260810 01:41:19.454651 26672 connection.cc:535] client connection to 127.0.0.1:35107 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35107): Connection reset by peer (error 104)
2026-08-10T01:41:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1638 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:19 dist-test-slave-t3q3 krb5kdc[26873](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:19 dist-test-slave-t3q3 krb5kdc[26873](info): set up 2 sockets
Aug 10 01:41:19 dist-test-slave-t3q3 krb5kdc[26873](info): commencing operation
krb5kdc: starting...
W20260810 01:41:20.706868 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:20 dist-test-slave-t3q3 krb5kdc[26873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:20.843591 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46421
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:20.960500 26891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:20.960832 26891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:20.960918 26891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:20.964982 26891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:20.965073 26891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:20.965112 26891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:20.965165 26891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:20.965207 26891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:20.970439 26891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:20.971516 26891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:20.972623 26891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:20.981200 26900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:20.981168 26901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:20.981189 26904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:20.981444 26891 server_base.cc:1034] running on GCE node
I20260810 01:41:20.982092 26891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:20.983155 26891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:20.984346 26891 hybrid_clock.cc:648] HybridClock initialized: now 1786326080984311 us; error 43 us; skew 500 ppm
Aug 10 01:41:20 dist-test-slave-t3q3 krb5kdc[26873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326080, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:20.987124 26891 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:20.987988 26891 webserver.cc:460] Webserver started at http://127.0.0.1:42687/ using document root <none> and password file <none>
I20260810 01:41:20.988565 26891 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:20.988667 26891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:20.988902 26891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:20.991044 26891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "10c2073c8cb249a8a7c4238d14b06ac9"
format_stamp: "Formatted at 2026-08-10 01:41:20 on dist-test-slave-t3q3"
server_key: "01bc633d64275903fe5fd729c2ae7cff"
server_key_iv: "7510204372e5e1525be3e0bf9e1f2a67"
server_key_version: "encryptionkey@0"
I20260810 01:41:20.991634 26891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "10c2073c8cb249a8a7c4238d14b06ac9"
format_stamp: "Formatted at 2026-08-10 01:41:20 on dist-test-slave-t3q3"
server_key: "01bc633d64275903fe5fd729c2ae7cff"
server_key_iv: "7510204372e5e1525be3e0bf9e1f2a67"
server_key_version: "encryptionkey@0"
I20260810 01:41:20.995570 26891 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:41:20.998138 26912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:20.999380 26891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:20.999526 26891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "10c2073c8cb249a8a7c4238d14b06ac9"
format_stamp: "Formatted at 2026-08-10 01:41:20 on dist-test-slave-t3q3"
server_key: "01bc633d64275903fe5fd729c2ae7cff"
server_key_iv: "7510204372e5e1525be3e0bf9e1f2a67"
server_key_version: "encryptionkey@0"
I20260810 01:41:20.999637 26891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:21.004400 26891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:21.007659 26891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:21.007879 26891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:21.015194 26891 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46421
I20260810 01:41:21.015210 27003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46421 every 8 connection(s)
I20260810 01:41:21.016222 26891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:21.019337 27004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:21.020886 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 26891
I20260810 01:41:21.021028 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:21.021391 25398 external_mini_cluster.cc:1428] Setting key 2b9649174e0d7329d475fd03e88456d5
I20260810 01:41:21.026046 27004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9: Bootstrap starting.
I20260810 01:41:21.026973 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:21.022960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:45193 (local address 127.0.0.1:46421)
0810 01:41:21.023442 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:21.023457 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:21.023495 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:41:21.024229 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:21.024248 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:21.024553 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:21.024895 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:21.025740 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:21.025745 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:21.025758 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:21.025769 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:21.025825 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:21.025844 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:21.025989 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:21.026070 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 01:41:21.026243 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":157,"threads_started":1}
I20260810 01:41:21.028643 27004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:21.029557 27004 log.cc:824] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:21.030126 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:21.031730 27004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9: No bootstrap required, opened a new log
I20260810 01:41:21.033901 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:21.032283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:59055 (local address 127.0.0.1:46421)
0810 01:41:21.032406 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:21.032410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:21.032593 (+ 183us) server_negotiation.cc:407] Connection header received
0810 01:41:21.032687 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:21.032691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:21.032729 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:21.032827 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:21.033527 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:21.033530 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:21.033533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:21.033545 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:21.033574 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:21.033586 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:21.033699 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:21.033736 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 01:41:21.033779 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:41:21.036206 27004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
I20260810 01:41:21.036451 27004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:21.036528 27004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c2073c8cb249a8a7c4238d14b06ac9, State: Initialized, Role: FOLLOWER
I20260810 01:41:21.036996 27004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
I20260810 01:41:21.037153 27004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:21.037222 27004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:21.037334 27004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:21.038328 27004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
I20260810 01:41:21.038689 27004 leader_election.cc:302] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10c2073c8cb249a8a7c4238d14b06ac9; no voters:
I20260810 01:41:21.039024 27004 leader_election.cc:288] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:21.039228 27018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:21.039520 27018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [term 1 LEADER]: Becoming Leader. State: Replica: 10c2073c8cb249a8a7c4238d14b06ac9, State: Running, Role: LEADER
I20260810 01:41:21.039834 27018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } }
I20260810 01:41:21.040351 27004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:21.041810 27021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10c2073c8cb249a8a7c4238d14b06ac9. Latest consensus state: current_term: 1 leader_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } } }
I20260810 01:41:21.041841 27020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c2073c8cb249a8a7c4238d14b06ac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46421 } } }
I20260810 01:41:21.041944 27021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:21.041946 27020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:21.042428 27036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:21.045713 27036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:21.051913 27036 catalog_manager.cc:1347] Generated new cluster ID: 18fcf85754a14081894fcc88e379db1f
I20260810 01:41:21.051983 27036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:21.068454 27036 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:21.068835 27036 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:21.080766 27036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10c2073c8cb249a8a7c4238d14b06ac9: Generated new TSK 0
I20260810 01:41:21.081525 27036 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:21.096148 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 26891
2026-08-10T01:41:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1654 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:21 dist-test-slave-t3q3 krb5kdc[27054](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:21 dist-test-slave-t3q3 krb5kdc[27054](info): set up 2 sockets
Aug 10 01:41:21 dist-test-slave-t3q3 krb5kdc[27054](info): commencing operation
krb5kdc: starting...
W20260810 01:41:22.359689 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:22 dist-test-slave-t3q3 krb5kdc[27054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:22.492867 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39847
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:22.613955 27083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:22.614264 27083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:22.614346 27083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:22.618342 27083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:22.618429 27083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:22.618468 27083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:22.618522 27083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:22.618561 27083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:22.624012 27083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39847
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:22.625131 27083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:22.626169 27083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:22.634644 27093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:22.634683 27091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:22.634701 27097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:22.634992 27083 server_base.cc:1034] running on GCE node
I20260810 01:41:22.635558 27083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:22.636672 27083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:22.637856 27083 hybrid_clock.cc:648] HybridClock initialized: now 1786326082637841 us; error 27 us; skew 500 ppm
Aug 10 01:41:22 dist-test-slave-t3q3 krb5kdc[27054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326082, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:22.640631 27083 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:22.641512 27083 webserver.cc:460] Webserver started at http://127.0.0.1:46251/ using document root <none> and password file <none>
I20260810 01:41:22.642062 27083 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:22.642150 27083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:22.642377 27083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:22.644460 27083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f"
format_stamp: "Formatted at 2026-08-10 01:41:22 on dist-test-slave-t3q3"
server_key: "a58932a4a757ee09689ab165ce752b6a"
server_key_iv: "b145992b555de698877b818f3419328d"
server_key_version: "encryptionkey@0"
I20260810 01:41:22.645025 27083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f"
format_stamp: "Formatted at 2026-08-10 01:41:22 on dist-test-slave-t3q3"
server_key: "a58932a4a757ee09689ab165ce752b6a"
server_key_iv: "b145992b555de698877b818f3419328d"
server_key_version: "encryptionkey@0"
I20260810 01:41:22.648684 27083 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:22.650990 27111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:22.652256 27083 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:22.652386 27083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f"
format_stamp: "Formatted at 2026-08-10 01:41:22 on dist-test-slave-t3q3"
server_key: "a58932a4a757ee09689ab165ce752b6a"
server_key_iv: "b145992b555de698877b818f3419328d"
server_key_version: "encryptionkey@0"
I20260810 01:41:22.652493 27083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:22.663532 27083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:22.666726 27083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:22.666919 27083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:22.674067 27083 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39847
I20260810 01:41:22.674094 27199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39847 every 8 connection(s)
I20260810 01:41:22.674988 27083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:22.677659 27200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:22.680955 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27083
I20260810 01:41:22.681124 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:22.681425 25398 external_mini_cluster.cc:1428] Setting key 8fa3188e8d7dc42342b09b4fe45f0140
I20260810 01:41:22.683631 27200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f: Bootstrap starting.
I20260810 01:41:22.686383 27200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:22.687260 27200 log.cc:824] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:22.689481 27200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f: No bootstrap required, opened a new log
Aug 10 01:41:22 dist-test-slave-t3q3 krb5kdc[27054](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:41:22.693766 27200 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39847 } }
I20260810 01:41:22.694051 27200 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:22.694175 27200 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd1e15fd5284ffeae0aed3f2bbdc83f, State: Initialized, Role: FOLLOWER
I20260810 01:41:22.694667 27200 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39847 } }
I20260810 01:41:22.694839 27200 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:22.694923 27200 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:22.695039 27200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:22.696048 27200 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39847 } }
I20260810 01:41:22.696439 27200 leader_election.cc:302] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdd1e15fd5284ffeae0aed3f2bbdc83f; no voters:
I20260810 01:41:22.696765 27200 leader_election.cc:288] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:22.696835 27211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:22.697050 27211 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [term 1 LEADER]: Becoming Leader. State: Replica: fdd1e15fd5284ffeae0aed3f2bbdc83f, State: Running, Role: LEADER
I20260810 01:41:22.697433 27211 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39847 } }
I20260810 01:41:22.697562 27207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:22.682855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:38539 (local address 127.0.0.1:39847)
0810 01:41:22.683288 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:22.683309 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:22.683352 (+ 43us) server_negotiation.cc:407] Connection header received
0810 01:41:22.684208 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:22.684234 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:22.684653 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:22.685041 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:22.685741 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:22.687282 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:22.688464 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:22.689127 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:22.689305 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:22.691886 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:22.691896 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:22.691918 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:22.691956 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:22.693988 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:22.694620 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:22.694626 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:22.694632 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:22.694780 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:22.695227 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:22.695230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:22.695231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:22.695612 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:22.695784 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:22.696242 (+ 458us) server_negotiation.cc:299] Negotiation successful
0810 01:41:22.696493 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":123,"threads_started":1}
I20260810 01:41:22.698163 27200 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:22.698590 27211 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39847 } } }
I20260810 01:41:22.698767 27211 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:22.699231 27216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:22.701126 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:22.701185 27212 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdd1e15fd5284ffeae0aed3f2bbdc83f. Latest consensus state: current_term: 1 leader_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd1e15fd5284ffeae0aed3f2bbdc83f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39847 } } }
I20260810 01:41:22.701270 27212 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:22.703015 27216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:22.709694 27216 catalog_manager.cc:1347] Generated new cluster ID: a0021624605143df9ad4f237d99dc54b
I20260810 01:41:22.709802 27216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:22.712180 27207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:22.703744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:52469 (local address 127.0.0.1:39847)
0810 01:41:22.703853 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:22.703859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:22.704239 (+ 380us) server_negotiation.cc:407] Connection header received
0810 01:41:22.704359 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:22.704362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:22.704406 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:22.704491 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:22.705134 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:22.705651 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:22.706492 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:22.706743 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:22.706847 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:22.708454 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:22.708457 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:22.708460 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:22.708496 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:22.710239 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:22.710817 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:22.710820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:22.710822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:22.710901 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:22.711248 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:22.711251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:22.711252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:22.711426 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:22.711522 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:22.711902 (+ 380us) server_negotiation.cc:299] Negotiation successful
0810 01:41:22.711995 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:41:22.720053 27216 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:22.720924 27216 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:22.727231 27216 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdd1e15fd5284ffeae0aed3f2bbdc83f: Generated new TSK 0
I20260810 01:41:22.728093 27216 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:22.733121 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27083
W20260810 01:41:22.746459 27052 connection.cc:535] client connection to 127.0.0.1:39847 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39847): Connection reset by peer (error 104)
2026-08-10T01:41:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1637 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:22 dist-test-slave-t3q3 krb5kdc[27249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:22 dist-test-slave-t3q3 krb5kdc[27249](info): set up 2 sockets
Aug 10 01:41:22 dist-test-slave-t3q3 krb5kdc[27249](info): commencing operation
krb5kdc: starting...
W20260810 01:41:24.011322 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:24 dist-test-slave-t3q3 krb5kdc[27249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:24.141382 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37997
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:24.254146 27276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:24.254405 27276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:24.254446 27276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:24.258414 27276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:24.258471 27276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:24.258490 27276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:24.258507 27276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:24.258522 27276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:24.263616 27276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37997
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:24.264640 27276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:24.265656 27276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:24.274310 27286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:24.274319 27288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:24.274319 27285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:24.274478 27276 server_base.cc:1034] running on GCE node
I20260810 01:41:24.275311 27276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:24.276475 27276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:24.277662 27276 hybrid_clock.cc:648] HybridClock initialized: now 1786326084277643 us; error 37 us; skew 500 ppm
Aug 10 01:41:24 dist-test-slave-t3q3 krb5kdc[27249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326084, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:24.285060 27276 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:24.286084 27276 webserver.cc:460] Webserver started at http://127.0.0.1:37515/ using document root <none> and password file <none>
I20260810 01:41:24.286679 27276 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:24.286772 27276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:24.287012 27276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:24.289242 27276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "f9997cd995f547e5895f444a9b9271e6"
format_stamp: "Formatted at 2026-08-10 01:41:24 on dist-test-slave-t3q3"
server_key: "6f8ce1f3e8984b8af4ed6f6f43f4b786"
server_key_iv: "9d70e65a239d00c6a9967eb464a6aa30"
server_key_version: "encryptionkey@0"
I20260810 01:41:24.289820 27276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "f9997cd995f547e5895f444a9b9271e6"
format_stamp: "Formatted at 2026-08-10 01:41:24 on dist-test-slave-t3q3"
server_key: "6f8ce1f3e8984b8af4ed6f6f43f4b786"
server_key_iv: "9d70e65a239d00c6a9967eb464a6aa30"
server_key_version: "encryptionkey@0"
I20260810 01:41:24.293645 27276 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:41:24.296103 27297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:24.297278 27276 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:41:24.297426 27276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "f9997cd995f547e5895f444a9b9271e6"
format_stamp: "Formatted at 2026-08-10 01:41:24 on dist-test-slave-t3q3"
server_key: "6f8ce1f3e8984b8af4ed6f6f43f4b786"
server_key_iv: "9d70e65a239d00c6a9967eb464a6aa30"
server_key_version: "encryptionkey@0"
I20260810 01:41:24.297537 27276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:24.324800 27276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:24.327855 27276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:24.328114 27276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:24.335602 27276 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37997
I20260810 01:41:24.335629 27384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37997 every 8 connection(s)
I20260810 01:41:24.336656 27276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:24.338295 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27276
I20260810 01:41:24.338456 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:24.338811 25398 external_mini_cluster.cc:1428] Setting key 45a6cbd9c2b261a0dec7454569de9dac
I20260810 01:41:24.340090 27385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:24.346670 27385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6: Bootstrap starting.
I20260810 01:41:24.348272 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:24.340328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:56527 (local address 127.0.0.1:37997)
0810 01:41:24.340780 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:24.340797 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:24.340835 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:41:24.341494 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:24.341510 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:24.341853 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:24.342144 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:24.342460 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:24.343438 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:24.344753 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:24.345271 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:24.345399 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:24.346390 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:24.346395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:24.346409 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:24.346835 (+ 426us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:24.346910 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:24.346936 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:24.347069 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:24.347250 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 01:41:24.347417 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":146,"threads_started":1}
I20260810 01:41:24.349359 27385 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:24.350175 27385 log.cc:824] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:24.351373 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:24.352427 27385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6: No bootstrap required, opened a new log
I20260810 01:41:24.356344 27385 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9997cd995f547e5895f444a9b9271e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37997 } }
I20260810 01:41:24.356607 27385 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:24.356686 27385 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9997cd995f547e5895f444a9b9271e6, State: Initialized, Role: FOLLOWER
I20260810 01:41:24.357164 27385 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9997cd995f547e5895f444a9b9271e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37997 } }
I20260810 01:41:24.357332 27385 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:24.357427 27385 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:24.357563 27385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:24.357734 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:24.353525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:50829 (local address 127.0.0.1:37997)
0810 01:41:24.353635 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:24.353644 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:24.353874 (+ 230us) server_negotiation.cc:407] Connection header received
0810 01:41:24.354026 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:24.354030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:24.354086 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:24.354165 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:24.354443 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:24.354963 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:24.355850 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:24.356151 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:24.356256 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:24.357211 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:24.357214 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:24.357217 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:24.357230 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:24.357263 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:24.357274 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:24.357365 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:24.357550 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 01:41:24.357590 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:41:24.358863 27385 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9997cd995f547e5895f444a9b9271e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37997 } }
I20260810 01:41:24.359230 27385 leader_election.cc:302] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9997cd995f547e5895f444a9b9271e6; no voters:
I20260810 01:41:24.359508 27385 leader_election.cc:288] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:24.359640 27400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:24.359884 27400 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [term 1 LEADER]: Becoming Leader. State: Replica: f9997cd995f547e5895f444a9b9271e6, State: Running, Role: LEADER
I20260810 01:41:24.360260 27400 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9997cd995f547e5895f444a9b9271e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37997 } }
I20260810 01:41:24.360803 27385 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:24.362075 27401 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9997cd995f547e5895f444a9b9271e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9997cd995f547e5895f444a9b9271e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37997 } } }
I20260810 01:41:24.362232 27401 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:24.362114 27402 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9997cd995f547e5895f444a9b9271e6. Latest consensus state: current_term: 1 leader_uuid: "f9997cd995f547e5895f444a9b9271e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9997cd995f547e5895f444a9b9271e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37997 } } }
I20260810 01:41:24.362367 27402 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:24.362720 27413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:24.365612 27413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:24.370828 27413 catalog_manager.cc:1347] Generated new cluster ID: ea340fe445ce4ddbb7350b35e49d450d
I20260810 01:41:24.370901 27413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:24.393790 27413 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:24.394829 27413 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:24.401002 27413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9997cd995f547e5895f444a9b9271e6: Generated new TSK 0
I20260810 01:41:24.401768 27413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:24.410076 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27276
W20260810 01:41:24.424475 27246 connection.cc:535] client connection to 127.0.0.1:37997 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37997): Connection reset by peer (error 104)
2026-08-10T01:41:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1678 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:24 dist-test-slave-t3q3 krb5kdc[27430](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:24 dist-test-slave-t3q3 krb5kdc[27430](info): set up 2 sockets
Aug 10 01:41:24 dist-test-slave-t3q3 krb5kdc[27430](info): commencing operation
krb5kdc: starting...
W20260810 01:41:25.680564 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:25 dist-test-slave-t3q3 krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:41:25.809373 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33529
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:25.920347 27449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:25.920626 27449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:25.920670 27449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:25.924584 27449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:25.924633 27449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:25.924652 27449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:25.924669 27449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:25.924683 27449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:25.929828 27449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33529
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:25.930809 27449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:25.931764 27449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:25.940440 27456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:25.940426 27455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:25.940526 27449 server_base.cc:1034] running on GCE node
W20260810 01:41:25.940474 27462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:25.941288 27449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:25.942423 27449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:25.943635 27449 hybrid_clock.cc:648] HybridClock initialized: now 1786326085943602 us; error 52 us; skew 500 ppm
Aug 10 01:41:25 dist-test-slave-t3q3 krb5kdc[27430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326085, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:25.946594 27449 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:41:25.947582 27449 webserver.cc:460] Webserver started at http://127.0.0.1:40147/ using document root <none> and password file <none>
I20260810 01:41:25.948222 27449 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:25.948326 27449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:25.948550 27449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:25.950629 27449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "5eedfc61c8794463ba08cc88519012c6"
format_stamp: "Formatted at 2026-08-10 01:41:25 on dist-test-slave-t3q3"
server_key: "e6a485c806559bcce2bfcdb4d417108a"
server_key_iv: "ed25b57756e9b2aad885aa9b64f036da"
server_key_version: "encryptionkey@0"
I20260810 01:41:25.951251 27449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "5eedfc61c8794463ba08cc88519012c6"
format_stamp: "Formatted at 2026-08-10 01:41:25 on dist-test-slave-t3q3"
server_key: "e6a485c806559bcce2bfcdb4d417108a"
server_key_iv: "ed25b57756e9b2aad885aa9b64f036da"
server_key_version: "encryptionkey@0"
I20260810 01:41:25.955085 27449 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:41:25.958006 27470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:25.959537 27449 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:41:25.959673 27449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "5eedfc61c8794463ba08cc88519012c6"
format_stamp: "Formatted at 2026-08-10 01:41:25 on dist-test-slave-t3q3"
server_key: "e6a485c806559bcce2bfcdb4d417108a"
server_key_iv: "ed25b57756e9b2aad885aa9b64f036da"
server_key_version: "encryptionkey@0"
I20260810 01:41:25.959789 27449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:25.964359 27449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:25.967578 27449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:25.967780 27449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:25.974717 27449 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33529
I20260810 01:41:25.974747 27558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33529 every 8 connection(s)
I20260810 01:41:25.975623 27449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:25.978308 27560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:25.983675 27560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6: Bootstrap starting.
I20260810 01:41:25.985263 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27449
I20260810 01:41:25.985414 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:25.985725 25398 external_mini_cluster.cc:1428] Setting key cc8eafe22c7fb1e6c895e79efe3d3aa0
I20260810 01:41:25.986410 27560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:25.987324 27560 log.cc:824] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:25.989310 27560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6: No bootstrap required, opened a new log
I20260810 01:41:25.990944 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:25.986857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:44103 (local address 127.0.0.1:33529)
0810 01:41:25.987307 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:25.987323 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:25.987358 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:41:25.988291 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:25.988310 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:25.988590 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:25.988942 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:25.989769 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:25.989773 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:25.989785 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:25.989796 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:25.989857 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:25.989880 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:25.989999 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:25.990107 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 01:41:25.990272 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":128,"threads_started":1}
I20260810 01:41:25.993506 27560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eedfc61c8794463ba08cc88519012c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33529 } }
I20260810 01:41:25.993778 27560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:25.993854 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:25.993870 27560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eedfc61c8794463ba08cc88519012c6, State: Initialized, Role: FOLLOWER
I20260810 01:41:25.994324 27560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eedfc61c8794463ba08cc88519012c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33529 } }
I20260810 01:41:25.994500 27560 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:25.994567 27560 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:25.994678 27560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:25.995915 27560 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eedfc61c8794463ba08cc88519012c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33529 } }
I20260810 01:41:25.996335 27560 leader_election.cc:302] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5eedfc61c8794463ba08cc88519012c6; no voters:
I20260810 01:41:25.996682 27560 leader_election.cc:288] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:25.996737 27577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:25.996974 27577 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [term 1 LEADER]: Becoming Leader. State: Replica: 5eedfc61c8794463ba08cc88519012c6, State: Running, Role: LEADER
I20260810 01:41:25.997273 27577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eedfc61c8794463ba08cc88519012c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33529 } }
I20260810 01:41:25.997895 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:25.996155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:55369 (local address 127.0.0.1:33529)
0810 01:41:25.996278 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:25.996282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:25.996464 (+ 182us) server_negotiation.cc:407] Connection header received
0810 01:41:25.996615 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:25.996618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:25.996654 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:25.996736 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:25.997469 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:25.997472 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:25.997474 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:25.997486 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:25.997516 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:25.997531 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:25.997589 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:25.997748 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 01:41:25.997783 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:41:25.997972 27560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:25.998502 27578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5eedfc61c8794463ba08cc88519012c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eedfc61c8794463ba08cc88519012c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33529 } } }
I20260810 01:41:25.998621 27578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:25.999321 27579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eedfc61c8794463ba08cc88519012c6. Latest consensus state: current_term: 1 leader_uuid: "5eedfc61c8794463ba08cc88519012c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eedfc61c8794463ba08cc88519012c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33529 } } }
I20260810 01:41:25.999409 27579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:25.999782 27583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:26.002910 27583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:26.008589 27583 catalog_manager.cc:1347] Generated new cluster ID: b6992153f8de4315b91362ec1110bbf8
I20260810 01:41:26.008670 27583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:26.015425 27583 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:26.015746 27583 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:26.020987 27583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5eedfc61c8794463ba08cc88519012c6: Generated new TSK 0
I20260810 01:41:26.021759 27583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:26.025012 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27449
2026-08-10T01:41:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1623 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:26 dist-test-slave-t3q3 krb5kdc[27610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:26 dist-test-slave-t3q3 krb5kdc[27610](info): set up 2 sockets
Aug 10 01:41:26 dist-test-slave-t3q3 krb5kdc[27610](info): commencing operation
krb5kdc: starting...
W20260810 01:41:27.293063 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:27 dist-test-slave-t3q3 krb5kdc[27610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:27.423348 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44773
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:32895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:44773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:27.540189 27629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:27.540469 27629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:27.540576 27629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:27.544603 27629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:27.544679 27629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:27.544714 27629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:27.544765 27629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:27.544802 27629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:27.550072 27629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:32895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:44773
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:44773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:27.551105 27629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:27.552173 27629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:27.560684 27636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:27.560880 27629 server_base.cc:1034] running on GCE node
W20260810 01:41:27.560782 27640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:27.560681 27635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:27.561708 27629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:27.563032 27629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:27.564159 27629 hybrid_clock.cc:648] HybridClock initialized: now 1786326087564138 us; error 32 us; skew 500 ppm
Aug 10 01:41:27 dist-test-slave-t3q3 krb5kdc[27610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326087, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:27.570060 27629 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:27.570981 27629 webserver.cc:460] Webserver started at http://127.24.205.190:46305/ using document root <none> and password file <none>
I20260810 01:41:27.571503 27629 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:27.571573 27629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:27.571743 27629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:27.573824 27629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "eff00f9e768d4330a3f0b71c53cd19e4"
format_stamp: "Formatted at 2026-08-10 01:41:27 on dist-test-slave-t3q3"
server_key: "89ac0b6336f63613b60b3fbae7344819"
server_key_iv: "dd23985c55ab4bfd9562629b5ee776f4"
server_key_version: "encryptionkey@0"
I20260810 01:41:27.574345 27629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "eff00f9e768d4330a3f0b71c53cd19e4"
format_stamp: "Formatted at 2026-08-10 01:41:27 on dist-test-slave-t3q3"
server_key: "89ac0b6336f63613b60b3fbae7344819"
server_key_iv: "dd23985c55ab4bfd9562629b5ee776f4"
server_key_version: "encryptionkey@0"
I20260810 01:41:27.578040 27629 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:41:27.580492 27649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:27.581807 27629 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:27.581955 27629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "eff00f9e768d4330a3f0b71c53cd19e4"
format_stamp: "Formatted at 2026-08-10 01:41:27 on dist-test-slave-t3q3"
server_key: "89ac0b6336f63613b60b3fbae7344819"
server_key_iv: "dd23985c55ab4bfd9562629b5ee776f4"
server_key_version: "encryptionkey@0"
I20260810 01:41:27.582069 27629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:27.599771 27629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:27.603281 27629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:27.603657 27629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:27.611181 27629 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:44773
I20260810 01:41:27.611207 27733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:44773 every 8 connection(s)
I20260810 01:41:27.612242 27629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:27.615067 27735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:27.620517 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27629
I20260810 01:41:27.620692 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:27.620990 25398 external_mini_cluster.cc:1428] Setting key a38621491cdc1c399c211590cd1e6233
I20260810 01:41:27.621518 27735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4: Bootstrap starting.
I20260810 01:41:27.624174 27735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:27.625110 27735 log.cc:824] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:27.627417 27735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4: No bootstrap required, opened a new log
Aug 10 01:41:27 dist-test-slave-t3q3 krb5kdc[27610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:27.632037 27735 raft_consensus.cc:348] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44773 } }
I20260810 01:41:27.632351 27735 raft_consensus.cc:374] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:27.632419 27735 raft_consensus.cc:729] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eff00f9e768d4330a3f0b71c53cd19e4, State: Initialized, Role: FOLLOWER
I20260810 01:41:27.632920 27735 consensus_queue.cc:260] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44773 } }
I20260810 01:41:27.633097 27735 raft_consensus.cc:388] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:27.633188 27735 raft_consensus.cc:482] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:27.633313 27735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:27.634603 27735 raft_consensus.cc:504] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44773 } }
I20260810 01:41:27.634997 27735 leader_election.cc:302] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eff00f9e768d4330a3f0b71c53cd19e4; no voters:
I20260810 01:41:27.635382 27735 leader_election.cc:288] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:27.635521 27747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:27.635793 27747 raft_consensus.cc:686] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [term 1 LEADER]: Becoming Leader. State: Replica: eff00f9e768d4330a3f0b71c53cd19e4, State: Running, Role: LEADER
I20260810 01:41:27.636209 27747 consensus_queue.cc:237] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44773 } }
I20260810 01:41:27.636838 27735 sys_catalog.cc:564] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:27.638136 27744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:27.622600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58261 (local address 127.24.205.190:44773)
0810 01:41:27.623071 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:27.623090 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:27.623134 (+ 44us) server_negotiation.cc:407] Connection header received
0810 01:41:27.623908 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:27.623929 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:27.624417 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:27.624736 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:27.625778 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:27.626998 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:27.628239 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:27.628731 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:27.628863 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:27.631936 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:27.631941 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:27.631956 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:27.631988 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:27.634357 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:27.634987 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:27.634994 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:27.635000 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:27.635159 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:27.635582 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:27.635588 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:27.635592 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:27.636210 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:27.636454 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:27.636762 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 01:41:27.637075 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":149,"threads_started":1}
I20260810 01:41:27.638263 27752 sys_catalog.cc:455] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eff00f9e768d4330a3f0b71c53cd19e4. Latest consensus state: current_term: 1 leader_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44773 } } }
I20260810 01:41:27.638383 27752 sys_catalog.cc:458] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:27.638724 27748 sys_catalog.cc:455] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eff00f9e768d4330a3f0b71c53cd19e4" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 44773 } } }
I20260810 01:41:27.638818 27748 sys_catalog.cc:458] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:27.641486 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 01:41:27.642127 27780 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:27.642221 27780 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:27.642284 27774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:27.643188 27774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:27.649613 27774 catalog_manager.cc:1347] Generated new cluster ID: b72da56dd47b47d99076c2f3988d2947
I20260810 01:41:27.649701 27774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:27.652156 27744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:27.643617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51205 (local address 127.24.205.190:44773)
0810 01:41:27.643735 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:27.643739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:27.643991 (+ 252us) server_negotiation.cc:407] Connection header received
0810 01:41:27.644167 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:27.644171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:27.644220 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:27.644261 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:27.645012 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:27.645546 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:27.646368 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:27.646619 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:27.646725 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:27.648387 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:27.648391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:27.648394 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:27.648420 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:27.650207 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:27.650761 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:27.650765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:27.650767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:27.650859 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:27.651200 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:27.651205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:27.651209 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:27.651433 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:27.651591 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:27.651857 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 01:41:27.651963 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:41:27.668563 27774 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:27.669878 27774 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:27.675954 27774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eff00f9e768d4330a3f0b71c53cd19e4: Generated new TSK 0
I20260810 01:41:27.676813 27774 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:27.682279 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27629
W20260810 01:41:27.700178 27607 connection.cc:535] client connection to 127.24.205.190:44773 recv error: Network error: failed to read from TLS socket (remote: 127.24.205.190:44773): Connection reset by peer (error 104)
2026-08-10T01:41:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1651 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:27 dist-test-slave-t3q3 krb5kdc[27798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:27 dist-test-slave-t3q3 krb5kdc[27798](info): set up 2 sockets
Aug 10 01:41:27 dist-test-slave-t3q3 krb5kdc[27798](info): commencing operation
krb5kdc: starting...
W20260810 01:41:28.952375 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:29 dist-test-slave-t3q3 krb5kdc[27798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:29.082921 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43981
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:38033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:43981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:29.197194 27820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:29.197459 27820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:29.197500 27820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:29.201524 27820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:29.201581 27820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:29.201599 27820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:29.201617 27820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:29.201669 27820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:29.206807 27820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:38033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:43981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:43981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:29.207827 27820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:29.208880 27820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:29.217453 27832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:29.217445 27828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:29.217446 27830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:29.217620 27820 server_base.cc:1034] running on GCE node
I20260810 01:41:29.218277 27820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:29.219326 27820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:29.220480 27820 hybrid_clock.cc:648] HybridClock initialized: now 1786326089220466 us; error 26 us; skew 500 ppm
Aug 10 01:41:29 dist-test-slave-t3q3 krb5kdc[27798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326089, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:29.223260 27820 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:29.224131 27820 webserver.cc:460] Webserver started at http://127.24.205.190:34571/ using document root <none> and password file <none>
I20260810 01:41:29.224654 27820 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:29.224716 27820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:29.224882 27820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:29.227279 27820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "925f2a33d6684583a8ca2515a81a64db"
format_stamp: "Formatted at 2026-08-10 01:41:29 on dist-test-slave-t3q3"
server_key: "2176cdc6aee9ae2ef2aa94c0a2153e11"
server_key_iv: "90321db04896387defb4c7b2bf49c3f3"
server_key_version: "encryptionkey@0"
I20260810 01:41:29.227864 27820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "925f2a33d6684583a8ca2515a81a64db"
format_stamp: "Formatted at 2026-08-10 01:41:29 on dist-test-slave-t3q3"
server_key: "2176cdc6aee9ae2ef2aa94c0a2153e11"
server_key_iv: "90321db04896387defb4c7b2bf49c3f3"
server_key_version: "encryptionkey@0"
I20260810 01:41:29.231559 27820 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:41:29.233950 27844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:29.235174 27820 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:29.235311 27820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "925f2a33d6684583a8ca2515a81a64db"
format_stamp: "Formatted at 2026-08-10 01:41:29 on dist-test-slave-t3q3"
server_key: "2176cdc6aee9ae2ef2aa94c0a2153e11"
server_key_iv: "90321db04896387defb4c7b2bf49c3f3"
server_key_version: "encryptionkey@0"
I20260810 01:41:29.235411 27820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:29.251138 27820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:29.254413 27820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:29.254581 27820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:29.261771 27820 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:43981
I20260810 01:41:29.261848 27932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:43981 every 8 connection(s)
I20260810 01:41:29.262791 27820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:29.265671 27934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:29.270241 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 27820
I20260810 01:41:29.270406 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:29.270730 25398 external_mini_cluster.cc:1428] Setting key 0b5ce7ec84c38404d880beea883f143b
I20260810 01:41:29.271679 27934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db: Bootstrap starting.
I20260810 01:41:29.274093 27934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:29.274960 27934 log.cc:824] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:29.277169 27934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db: No bootstrap required, opened a new log
I20260810 01:41:29.280673 27938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:29.272293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59263 (local address 127.24.205.190:43981)
0810 01:41:29.272757 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:29.272775 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:29.272813 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:41:29.273525 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:29.273543 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:29.273908 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:29.274256 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:29.274638 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:29.275784 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:29.277062 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:29.277656 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:29.277791 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:29.278746 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:29.278751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:29.278765 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:29.279216 (+ 451us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:29.279274 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:29.279300 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:29.279414 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:29.279647 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 01:41:29.279808 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":164,"threads_started":1}
I20260810 01:41:29.281255 27934 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925f2a33d6684583a8ca2515a81a64db" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43981 } }
I20260810 01:41:29.281477 27934 raft_consensus.cc:374] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:29.281533 27934 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925f2a33d6684583a8ca2515a81a64db, State: Initialized, Role: FOLLOWER
I20260810 01:41:29.282016 27934 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925f2a33d6684583a8ca2515a81a64db" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43981 } }
I20260810 01:41:29.282186 27934 raft_consensus.cc:388] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:29.282251 27934 raft_consensus.cc:482] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:29.282348 27934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:29.283416 27934 raft_consensus.cc:504] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925f2a33d6684583a8ca2515a81a64db" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43981 } }
I20260810 01:41:29.283821 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:29.283788 27934 leader_election.cc:302] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 925f2a33d6684583a8ca2515a81a64db; no voters:
I20260810 01:41:29.284139 27934 leader_election.cc:288] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:29.284298 27941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:29.284562 27941 raft_consensus.cc:686] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [term 1 LEADER]: Becoming Leader. State: Replica: 925f2a33d6684583a8ca2515a81a64db, State: Running, Role: LEADER
I20260810 01:41:29.284912 27941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925f2a33d6684583a8ca2515a81a64db" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43981 } }
I20260810 01:41:29.285516 27934 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:29.286655 27950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "925f2a33d6684583a8ca2515a81a64db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925f2a33d6684583a8ca2515a81a64db" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43981 } } }
I20260810 01:41:29.286818 27950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:29.287182 27949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 925f2a33d6684583a8ca2515a81a64db. Latest consensus state: current_term: 1 leader_uuid: "925f2a33d6684583a8ca2515a81a64db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925f2a33d6684583a8ca2515a81a64db" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 43981 } } }
I20260810 01:41:29.287276 27949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db [sys.catalog]: This master's current role is: LEADER
W20260810 01:41:29.290650 27973 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:29.290755 27973 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:29.290879 27966 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:29.291488 27938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:29.286099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34909 (local address 127.24.205.190:43981)
0810 01:41:29.286205 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:29.286210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:29.286832 (+ 622us) server_negotiation.cc:407] Connection header received
0810 01:41:29.287044 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:29.287048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:29.287100 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:29.287167 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:29.287856 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:29.288583 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:29.289438 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:29.289762 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:29.289849 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:29.290964 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:29.290968 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:29.290971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:29.290983 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:29.291009 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:29.291021 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:29.291117 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:29.291312 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 01:41:29.291347 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:41:29.291805 27966 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:29.297291 27966 catalog_manager.cc:1347] Generated new cluster ID: aaa95e61f7c54ad4b168582fb05bc788
I20260810 01:41:29.297356 27966 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:29.322547 27966 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:29.323836 27966 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:29.331700 27966 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 925f2a33d6684583a8ca2515a81a64db: Generated new TSK 0
I20260810 01:41:29.332510 27966 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:29.337944 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 27820
W20260810 01:41:29.356945 27796 connection.cc:535] client connection to 127.24.205.190:43981 recv error: Network error: failed to read from TLS socket (remote: 127.24.205.190:43981): Connection reset by peer (error 104)
2026-08-10T01:41:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1656 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:29 dist-test-slave-t3q3 krb5kdc[27984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:29 dist-test-slave-t3q3 krb5kdc[27984](info): set up 2 sockets
Aug 10 01:41:29 dist-test-slave-t3q3 krb5kdc[27984](info): commencing operation
krb5kdc: starting...
W20260810 01:41:30.607580 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:30 dist-test-slave-t3q3 krb5kdc[27984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:30.745198 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37421
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:35045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:37421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:30.858469 28006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:30.858737 28006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:30.858779 28006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:30.862656 28006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:30.862708 28006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:30.862727 28006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:30.862744 28006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:30.862759 28006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:30.867759 28006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:35045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:37421
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:30.868762 28006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:30.869709 28006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:30.877985 28015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:30.877974 28013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:30.877974 28021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:30.878289 28006 server_base.cc:1034] running on GCE node
I20260810 01:41:30.878886 28006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:30.879966 28006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:30.881163 28006 hybrid_clock.cc:648] HybridClock initialized: now 1786326090881132 us; error 47 us; skew 500 ppm
Aug 10 01:41:30 dist-test-slave-t3q3 krb5kdc[27984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326090, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:30.883898 28006 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:30.884857 28006 webserver.cc:460] Webserver started at http://127.24.205.190:32879/ using document root <none> and password file <none>
I20260810 01:41:30.885417 28006 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:30.885517 28006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:30.885766 28006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:30.887799 28006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "1adb3307b96d4f94a9eca11761a8c23c"
format_stamp: "Formatted at 2026-08-10 01:41:30 on dist-test-slave-t3q3"
server_key: "167fcf90be8d2f5243f7ac8277cf5a91"
server_key_iv: "8c6ceb5351d01f6318e835d40140f874"
server_key_version: "encryptionkey@0"
I20260810 01:41:30.888401 28006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "1adb3307b96d4f94a9eca11761a8c23c"
format_stamp: "Formatted at 2026-08-10 01:41:30 on dist-test-slave-t3q3"
server_key: "167fcf90be8d2f5243f7ac8277cf5a91"
server_key_iv: "8c6ceb5351d01f6318e835d40140f874"
server_key_version: "encryptionkey@0"
I20260810 01:41:30.892150 28006 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260810 01:41:30.894635 28036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:30.895917 28006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 01:41:30.896136 28006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "1adb3307b96d4f94a9eca11761a8c23c"
format_stamp: "Formatted at 2026-08-10 01:41:30 on dist-test-slave-t3q3"
server_key: "167fcf90be8d2f5243f7ac8277cf5a91"
server_key_iv: "8c6ceb5351d01f6318e835d40140f874"
server_key_version: "encryptionkey@0"
I20260810 01:41:30.896260 28006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:30.900882 28006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:30.903821 28006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:30.904021 28006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:30.911264 28006 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:37421
I20260810 01:41:30.911293 28114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:37421 every 8 connection(s)
I20260810 01:41:30.912232 28006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:30.915014 28115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:30.920899 28115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c: Bootstrap starting.
I20260810 01:41:30.921540 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28006
I20260810 01:41:30.921686 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:30.922008 25398 external_mini_cluster.cc:1428] Setting key 3c55e5ba94a7057869dd86a85de570bb
I20260810 01:41:30.923847 28115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:30.924836 28115 log.cc:824] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:30.927237 28115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c: No bootstrap required, opened a new log
I20260810 01:41:30.927857 28121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:30.923353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58057 (local address 127.24.205.190:37421)
0810 01:41:30.923848 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:30.923870 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:30.923917 (+ 47us) server_negotiation.cc:407] Connection header received
0810 01:41:30.924871 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:30.924897 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:30.925295 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:30.925594 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:30.926387 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:30.926397 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:30.926413 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:30.926427 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:30.926494 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:30.926526 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:30.926639 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:30.926739 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 01:41:30.926896 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":111,"threads_started":1}
I20260810 01:41:30.930688 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:30.931491 28115 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1adb3307b96d4f94a9eca11761a8c23c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37421 } }
I20260810 01:41:30.931815 28115 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:30.931896 28115 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1adb3307b96d4f94a9eca11761a8c23c, State: Initialized, Role: FOLLOWER
I20260810 01:41:30.932456 28115 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1adb3307b96d4f94a9eca11761a8c23c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37421 } }
I20260810 01:41:30.932667 28115 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:30.932747 28115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:30.932858 28115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:30.934280 28115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1adb3307b96d4f94a9eca11761a8c23c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37421 } }
I20260810 01:41:30.934679 28115 leader_election.cc:302] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1adb3307b96d4f94a9eca11761a8c23c; no voters:
I20260810 01:41:30.935024 28115 leader_election.cc:288] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:30.935030 28121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:30.933367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38535 (local address 127.24.205.190:37421)
0810 01:41:30.933485 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:30.933489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:30.933639 (+ 150us) server_negotiation.cc:407] Connection header received
0810 01:41:30.933742 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:30.933747 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:30.933782 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:30.933853 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:30.934615 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:30.934619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:30.934621 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:30.934633 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:30.934662 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:30.934674 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:30.934773 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:30.934847 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 01:41:30.934885 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:41:30.935160 28135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:30.935384 28135 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [term 1 LEADER]: Becoming Leader. State: Replica: 1adb3307b96d4f94a9eca11761a8c23c, State: Running, Role: LEADER
I20260810 01:41:30.935732 28135 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1adb3307b96d4f94a9eca11761a8c23c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37421 } }
I20260810 01:41:30.936370 28115 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:30.937599 28137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1adb3307b96d4f94a9eca11761a8c23c. Latest consensus state: current_term: 1 leader_uuid: "1adb3307b96d4f94a9eca11761a8c23c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1adb3307b96d4f94a9eca11761a8c23c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37421 } } }
I20260810 01:41:30.937734 28137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:30.938092 28136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1adb3307b96d4f94a9eca11761a8c23c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1adb3307b96d4f94a9eca11761a8c23c" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37421 } } }
I20260810 01:41:30.938146 28148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:30.938205 28136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:30.941247 28148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:30.947228 28148 catalog_manager.cc:1347] Generated new cluster ID: 2e8d8051e3df4dc7aaaa57edd53978b1
I20260810 01:41:30.947314 28148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:30.975869 28148 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:30.976264 28148 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:30.980782 28148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1adb3307b96d4f94a9eca11761a8c23c: Generated new TSK 0
I20260810 01:41:30.981468 28148 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:30.987358 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28006
2026-08-10T01:41:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1652 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:31 dist-test-slave-t3q3 krb5kdc[28172](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:31 dist-test-slave-t3q3 krb5kdc[28172](info): set up 2 sockets
Aug 10 01:41:31 dist-test-slave-t3q3 krb5kdc[28172](info): commencing operation
krb5kdc: starting...
W20260810 01:41:32.248004 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:32 dist-test-slave-t3q3 krb5kdc[28172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:32.374930 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37391
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:43681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:37391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:32.487389 28192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:32.487728 28192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:32.487811 28192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:32.491865 28192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:32.491969 28192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:32.492017 28192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:32.492094 28192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:32.492133 28192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:32.497556 28192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:43681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:37391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:37391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:32.498729 28192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:32.499838 28192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:32.508687 28200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:32.508699 28203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:32.508759 28192 server_base.cc:1034] running on GCE node
W20260810 01:41:32.508687 28199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:32.509507 28192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:32.510674 28192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:32.511840 28192 hybrid_clock.cc:648] HybridClock initialized: now 1786326092511810 us; error 42 us; skew 500 ppm
Aug 10 01:41:32 dist-test-slave-t3q3 krb5kdc[28172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326092, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:32.514839 28192 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:32.515729 28192 webserver.cc:460] Webserver started at http://127.24.205.190:43083/ using document root <none> and password file <none>
I20260810 01:41:32.516363 28192 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:32.516430 28192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:32.516607 28192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:32.518672 28192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "998f315859bf4bae85299af22053dd0f"
format_stamp: "Formatted at 2026-08-10 01:41:32 on dist-test-slave-t3q3"
server_key: "a5d94c7edfad8c092c2514894e3b4f6e"
server_key_iv: "e9b4b106e06000d3a5292aadadfaa3a7"
server_key_version: "encryptionkey@0"
I20260810 01:41:32.519202 28192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "998f315859bf4bae85299af22053dd0f"
format_stamp: "Formatted at 2026-08-10 01:41:32 on dist-test-slave-t3q3"
server_key: "a5d94c7edfad8c092c2514894e3b4f6e"
server_key_iv: "e9b4b106e06000d3a5292aadadfaa3a7"
server_key_version: "encryptionkey@0"
I20260810 01:41:32.523198 28192 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 01:41:32.525816 28213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:32.527189 28192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:41:32.527329 28192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "998f315859bf4bae85299af22053dd0f"
format_stamp: "Formatted at 2026-08-10 01:41:32 on dist-test-slave-t3q3"
server_key: "a5d94c7edfad8c092c2514894e3b4f6e"
server_key_iv: "e9b4b106e06000d3a5292aadadfaa3a7"
server_key_version: "encryptionkey@0"
I20260810 01:41:32.527442 28192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:32.543319 28192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:32.547042 28192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:32.547281 28192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:32.554796 28192 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:37391
I20260810 01:41:32.554821 28293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:37391 every 8 connection(s)
I20260810 01:41:32.555823 28192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:32.558858 28296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:32.562327 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28192
I20260810 01:41:32.562480 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:32.562801 25398 external_mini_cluster.cc:1428] Setting key 8ff36654f587a623060f3ea364116544
I20260810 01:41:32.565359 28296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f: Bootstrap starting.
I20260810 01:41:32.567620 28296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:32.568470 28296 log.cc:824] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:32.570439 28296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f: No bootstrap required, opened a new log
I20260810 01:41:32.574142 28296 raft_consensus.cc:348] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998f315859bf4bae85299af22053dd0f" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37391 } }
I20260810 01:41:32.574381 28296 raft_consensus.cc:374] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:32.574476 28296 raft_consensus.cc:729] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f315859bf4bae85299af22053dd0f, State: Initialized, Role: FOLLOWER
I20260810 01:41:32.575019 28296 consensus_queue.cc:260] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998f315859bf4bae85299af22053dd0f" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37391 } }
I20260810 01:41:32.575215 28296 raft_consensus.cc:388] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:32.575297 28296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:32.575402 28296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:32.576439 28296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998f315859bf4bae85299af22053dd0f" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37391 } }
Aug 10 01:41:32 dist-test-slave-t3q3 krb5kdc[28172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:32.576800 28296 leader_election.cc:302] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998f315859bf4bae85299af22053dd0f; no voters:
I20260810 01:41:32.577137 28296 leader_election.cc:288] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:32.577282 28302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:32.577522 28302 raft_consensus.cc:686] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [term 1 LEADER]: Becoming Leader. State: Replica: 998f315859bf4bae85299af22053dd0f, State: Running, Role: LEADER
I20260810 01:41:32.577950 28302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998f315859bf4bae85299af22053dd0f" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37391 } }
I20260810 01:41:32.578518 28296 sys_catalog.cc:564] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:32.579877 28303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "998f315859bf4bae85299af22053dd0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998f315859bf4bae85299af22053dd0f" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37391 } } }
I20260810 01:41:32.580008 28303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:32.580442 28304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 998f315859bf4bae85299af22053dd0f. Latest consensus state: current_term: 1 leader_uuid: "998f315859bf4bae85299af22053dd0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998f315859bf4bae85299af22053dd0f" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 37391 } } }
I20260810 01:41:32.580622 28304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:32.581295 28320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:32.583370 28299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:32.564361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48637 (local address 127.24.205.190:37391)
0810 01:41:32.564831 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:32.564848 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:32.564886 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:41:32.565607 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:32.565626 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:32.565981 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:32.566336 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:32.567195 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:32.568379 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:32.569538 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:32.570029 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:32.570222 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:32.577587 (+ 7365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:32.577596 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:32.577619 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:32.577677 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:32.579982 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:32.580624 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:32.580632 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:32.580641 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:32.580809 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:32.581208 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:32.581212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:32.581214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:32.581679 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:32.581844 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:32.582206 (+ 362us) server_negotiation.cc:299] Negotiation successful
0810 01:41:32.582547 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":145,"threads_started":1}
I20260810 01:41:32.585237 28320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:32.586619 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:32.591246 28320 catalog_manager.cc:1347] Generated new cluster ID: c6b27eea6b0046699386503a5b547e0d
I20260810 01:41:32.591317 28320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:32.601248 28299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:32.588958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53363 (local address 127.24.205.190:37391)
0810 01:41:32.589066 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:32.589070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:32.592428 (+ 3358us) server_negotiation.cc:407] Connection header received
0810 01:41:32.592560 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:32.592563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:32.592609 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:32.592693 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:32.593566 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:32.594370 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:32.595559 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:32.595922 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:32.596010 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:32.597714 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:32.597718 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:32.597721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:32.597745 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:32.599384 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:32.599875 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:32.599878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:32.599880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:32.599959 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:32.600284 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:32.600287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:32.600289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:32.600478 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:32.600612 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:32.600858 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 01:41:32.600967 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:41:32.604214 28320 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:32.605366 28320 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:32.610430 28320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 998f315859bf4bae85299af22053dd0f: Generated new TSK 0
I20260810 01:41:32.611052 28320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:32.615684 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28192
2026-08-10T01:41:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1622 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:32 dist-test-slave-t3q3 krb5kdc[28348](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:32 dist-test-slave-t3q3 krb5kdc[28348](info): set up 2 sockets
Aug 10 01:41:32 dist-test-slave-t3q3 krb5kdc[28348](info): commencing operation
krb5kdc: starting...
W20260810 01:41:33.884001 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:33 dist-test-slave-t3q3 krb5kdc[28348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:34.019248 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34331
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:32989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:34331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:34.133109 28372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:34.133435 28372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:34.133517 28372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:34.137507 28372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:34.137600 28372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:34.137641 28372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:34.137677 28372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:34.137713 28372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:34.142927 28372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:32989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:34331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:34331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:34.143987 28372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:34.145054 28372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:34.153822 28382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:34.153847 28385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:34.153966 28372 server_base.cc:1034] running on GCE node
W20260810 01:41:34.153817 28381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:34.154739 28372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:34.155829 28372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:34.156993 28372 hybrid_clock.cc:648] HybridClock initialized: now 1786326094156961 us; error 46 us; skew 500 ppm
Aug 10 01:41:34 dist-test-slave-t3q3 krb5kdc[28348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326094, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:34.159787 28372 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:34.160759 28372 webserver.cc:460] Webserver started at http://127.24.205.190:40227/ using document root <none> and password file <none>
I20260810 01:41:34.161350 28372 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:34.161414 28372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:34.161648 28372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:34.163887 28372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "ec80714fff974e618539e5ecce1dafab"
format_stamp: "Formatted at 2026-08-10 01:41:34 on dist-test-slave-t3q3"
server_key: "484c3028cc16af907ba4c2b8f3ff7275"
server_key_iv: "9f543d1c85c97d8a6fd984e0ac0f790c"
server_key_version: "encryptionkey@0"
I20260810 01:41:34.164566 28372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "ec80714fff974e618539e5ecce1dafab"
format_stamp: "Formatted at 2026-08-10 01:41:34 on dist-test-slave-t3q3"
server_key: "484c3028cc16af907ba4c2b8f3ff7275"
server_key_iv: "9f543d1c85c97d8a6fd984e0ac0f790c"
server_key_version: "encryptionkey@0"
I20260810 01:41:34.168455 28372 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:41:34.170931 28400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:34.172310 28372 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:34.172465 28372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "ec80714fff974e618539e5ecce1dafab"
format_stamp: "Formatted at 2026-08-10 01:41:34 on dist-test-slave-t3q3"
server_key: "484c3028cc16af907ba4c2b8f3ff7275"
server_key_iv: "9f543d1c85c97d8a6fd984e0ac0f790c"
server_key_version: "encryptionkey@0"
I20260810 01:41:34.172582 28372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:34.184991 28372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:34.188198 28372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:34.188405 28372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:34.195600 28372 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:34331
I20260810 01:41:34.195619 28473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:34331 every 8 connection(s)
I20260810 01:41:34.196589 28372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:34.199337 28475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:34.204800 28475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab: Bootstrap starting.
I20260810 01:41:34.206794 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28372
I20260810 01:41:34.206954 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:34.207278 25398 external_mini_cluster.cc:1428] Setting key 62661a02e63c85ba518ee892d9d5585f
I20260810 01:41:34.207403 28475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:34.208425 28475 log.cc:824] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:34.210847 28475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab: No bootstrap required, opened a new log
I20260810 01:41:34.215273 28475 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec80714fff974e618539e5ecce1dafab" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34331 } }
I20260810 01:41:34.215492 28475 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:34.215570 28475 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec80714fff974e618539e5ecce1dafab, State: Initialized, Role: FOLLOWER
I20260810 01:41:34.216032 28475 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec80714fff974e618539e5ecce1dafab" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34331 } }
I20260810 01:41:34.216243 28475 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:34.216331 28475 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:34.216454 28475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:34.217473 28475 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec80714fff974e618539e5ecce1dafab" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34331 } }
I20260810 01:41:34.217765 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:34.208632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58987 (local address 127.24.205.190:34331)
0810 01:41:34.209167 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:34.209182 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:34.209218 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:41:34.210054 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:34.210081 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:34.210496 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:34.210877 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:34.211307 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:34.212851 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:34.213829 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:34.214609 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:34.214769 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:34.215663 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:34.215668 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:34.215704 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:34.216274 (+ 570us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:34.216349 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:34.216378 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:34.216502 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:34.216663 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 01:41:34.216907 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":229,"threads_started":1}
I20260810 01:41:34.217828 28475 leader_election.cc:302] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec80714fff974e618539e5ecce1dafab; no voters:
I20260810 01:41:34.218238 28475 leader_election.cc:288] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:34.218293 28480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:34.218492 28480 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [term 1 LEADER]: Becoming Leader. State: Replica: ec80714fff974e618539e5ecce1dafab, State: Running, Role: LEADER
I20260810 01:41:34.218863 28480 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec80714fff974e618539e5ecce1dafab" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34331 } }
I20260810 01:41:34.219542 28475 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:34.220109 28483 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec80714fff974e618539e5ecce1dafab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec80714fff974e618539e5ecce1dafab" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34331 } } }
I20260810 01:41:34.220312 28483 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:34.220592 28481 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec80714fff974e618539e5ecce1dafab. Latest consensus state: current_term: 1 leader_uuid: "ec80714fff974e618539e5ecce1dafab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec80714fff974e618539e5ecce1dafab" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 34331 } } }
I20260810 01:41:34.220714 28481 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:34.220889 28495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:34.220932 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:34.224324 28495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:34.229491 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:34.224618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58231 (local address 127.24.205.190:34331)
0810 01:41:34.224740 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:34.224744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:34.225255 (+ 511us) server_negotiation.cc:407] Connection header received
0810 01:41:34.225373 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:34.225376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:34.225425 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:34.225507 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:34.225911 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:34.226688 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:34.227535 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:34.227776 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:34.227901 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:34.228821 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:34.228825 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:34.228828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:34.228842 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:34.228872 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:34.228886 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:34.228957 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:34.229292 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 01:41:34.229348 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:41:34.231102 28495 catalog_manager.cc:1347] Generated new cluster ID: 20ded826bd194f5eb270517399928a1d
I20260810 01:41:34.231199 28495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:34.240902 28495 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:34.242157 28495 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:34.250348 28495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec80714fff974e618539e5ecce1dafab: Generated new TSK 0
I20260810 01:41:34.251117 28495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:34.258046 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28372
2026-08-10T01:41:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1647 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:34 dist-test-slave-t3q3 krb5kdc[28532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:34 dist-test-slave-t3q3 krb5kdc[28532](info): set up 2 sockets
Aug 10 01:41:34 dist-test-slave-t3q3 krb5kdc[28532](info): commencing operation
krb5kdc: starting...
W20260810 01:41:35.549103 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:35 dist-test-slave-t3q3 krb5kdc[28532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:35.687223 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38705
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:38649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:38705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:35.801103 28553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:35.801391 28553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:35.801484 28553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:35.806639 28553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:35.806715 28553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:35.806751 28553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:35.806833 28553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:35.806870 28553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:35.812225 28553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:38649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:38705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:38705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:35.813227 28553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:35.814217 28553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:35.822892 28562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:35.822973 28553 server_base.cc:1034] running on GCE node
W20260810 01:41:35.822896 28564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:35.822896 28560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:35.823688 28553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:35.824819 28553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:35.826014 28553 hybrid_clock.cc:648] HybridClock initialized: now 1786326095825998 us; error 27 us; skew 500 ppm
Aug 10 01:41:35 dist-test-slave-t3q3 krb5kdc[28532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326095, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:35.828910 28553 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:35.829835 28553 webserver.cc:460] Webserver started at http://127.24.205.190:37565/ using document root <none> and password file <none>
I20260810 01:41:35.830407 28553 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:35.830502 28553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:35.830739 28553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:35.832859 28553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "e5390bc1a2584a50afc3e60c8f14da2d"
format_stamp: "Formatted at 2026-08-10 01:41:35 on dist-test-slave-t3q3"
server_key: "c57cf75e718f9dda7ab0ec5a219021f1"
server_key_iv: "e3eb7c72bb45fe6e18063e684930b3a3"
server_key_version: "encryptionkey@0"
I20260810 01:41:35.833441 28553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "e5390bc1a2584a50afc3e60c8f14da2d"
format_stamp: "Formatted at 2026-08-10 01:41:35 on dist-test-slave-t3q3"
server_key: "c57cf75e718f9dda7ab0ec5a219021f1"
server_key_iv: "e3eb7c72bb45fe6e18063e684930b3a3"
server_key_version: "encryptionkey@0"
I20260810 01:41:35.837286 28553 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 01:41:35.839636 28577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:35.840834 28553 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:35.840972 28553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "e5390bc1a2584a50afc3e60c8f14da2d"
format_stamp: "Formatted at 2026-08-10 01:41:35 on dist-test-slave-t3q3"
server_key: "c57cf75e718f9dda7ab0ec5a219021f1"
server_key_iv: "e3eb7c72bb45fe6e18063e684930b3a3"
server_key_version: "encryptionkey@0"
I20260810 01:41:35.841081 28553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:35.845571 28553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:35.848382 28553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:35.848573 28553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:35.855922 28553 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:38705
I20260810 01:41:35.855947 28657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:38705 every 8 connection(s)
I20260810 01:41:35.856900 28553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:35.859617 28658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:35.864413 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28553
I20260810 01:41:35.864555 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:35.864845 25398 external_mini_cluster.cc:1428] Setting key ef56dd745ba5b7f0509ac6700bba0bdb
I20260810 01:41:35.865444 28658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d: Bootstrap starting.
I20260810 01:41:35.868170 28658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:35.869104 28658 log.cc:824] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:35.870725 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:35.866345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53793 (local address 127.24.205.190:38705)
0810 01:41:35.866806 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:35.866825 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:35.866870 (+ 45us) server_negotiation.cc:407] Connection header received
0810 01:41:35.867704 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:35.867729 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:35.868109 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:35.868515 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:35.869264 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:35.869270 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:35.869285 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:35.869297 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:35.869361 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:35.869388 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:35.869511 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:35.869634 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 01:41:35.869811 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":117,"threads_started":1}
I20260810 01:41:35.871362 28658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d: No bootstrap required, opened a new log
I20260810 01:41:35.873744 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:35.875643 28658 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38705 } }
I20260810 01:41:35.875981 28658 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:35.876066 28658 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5390bc1a2584a50afc3e60c8f14da2d, State: Initialized, Role: FOLLOWER
I20260810 01:41:35.876585 28658 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38705 } }
I20260810 01:41:35.876761 28658 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:35.876832 28658 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:35.876931 28658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:35.877535 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:35.875779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39969 (local address 127.24.205.190:38705)
0810 01:41:35.875914 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:35.875920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:35.876201 (+ 281us) server_negotiation.cc:407] Connection header received
0810 01:41:35.876328 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:35.876331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:35.876367 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:35.876449 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:35.877159 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:35.877166 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:35.877171 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:41:35.877187 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:35.877216 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:41:35.877229 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:35.877324 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:35.877382 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 01:41:35.877418 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:41:35.878170 28658 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38705 } }
I20260810 01:41:35.878548 28658 leader_election.cc:302] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5390bc1a2584a50afc3e60c8f14da2d; no voters:
I20260810 01:41:35.878868 28658 leader_election.cc:288] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:35.879001 28678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:35.879252 28678 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [term 1 LEADER]: Becoming Leader. State: Replica: e5390bc1a2584a50afc3e60c8f14da2d, State: Running, Role: LEADER
I20260810 01:41:35.879613 28678 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38705 } }
I20260810 01:41:35.880214 28658 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:35.881273 28682 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5390bc1a2584a50afc3e60c8f14da2d. Latest consensus state: current_term: 1 leader_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38705 } } }
I20260810 01:41:35.881402 28682 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:35.881843 28681 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5390bc1a2584a50afc3e60c8f14da2d" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 38705 } } }
I20260810 01:41:35.881984 28681 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:35.882891 28694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:35.885637 28694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:35.891597 28694 catalog_manager.cc:1347] Generated new cluster ID: 9dc424538080498c80eda72e98893292
I20260810 01:41:35.891746 28694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:35.898967 28694 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:35.899317 28694 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:35.917552 28694 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5390bc1a2584a50afc3e60c8f14da2d: Generated new TSK 0
I20260810 01:41:35.918493 28694 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:41:35.927953 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28553
2026-08-10T01:41:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1663 ms)
[----------] 18 tests from AuthTokenIssuingTest (29743 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:35 dist-test-slave-t3q3 krb5kdc[28713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:35 dist-test-slave-t3q3 krb5kdc[28713](info): set up 2 sockets
Aug 10 01:41:35 dist-test-slave-t3q3 krb5kdc[28713](info): commencing operation
krb5kdc: starting...
W20260810 01:41:37.186173 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:37.318902 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:36185
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:37493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:36185,127.24.205.189:35035,127.24.205.188:33611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:37.439402 28731 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:41:37.439756 28731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:37.439831 28731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:37.439913 28731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:37.443946 28731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:37.444053 28731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:37.444123 28731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:37.444175 28731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:37.444211 28731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:37.449565 28731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:36185,127.24.205.189:35035,127.24.205.188:33611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:36185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:37.450657 28731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:37.451714 28731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:37.460563 28742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:37.460575 28741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:37.460575 28746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:37.461031 28731 server_base.cc:1034] running on GCE node
I20260810 01:41:37.461706 28731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:37.462880 28731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:37.464138 28731 hybrid_clock.cc:648] HybridClock initialized: now 1786326097464115 us; error 32 us; skew 500 ppm
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:37.466987 28731 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:37.467968 28731 webserver.cc:460] Webserver started at http://127.24.205.190:38693/ using document root <none> and password file <none>
I20260810 01:41:37.468601 28731 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:37.468701 28731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:37.468948 28731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:37.471062 28731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "c7bbc0a5e85d4e3da44507e8a8648d93"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "d9acd90b55d21cd5e7cc19d95f89407b"
server_key_iv: "5f84efb354f9fa639270e9e9b041578c"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.471666 28731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "c7bbc0a5e85d4e3da44507e8a8648d93"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "d9acd90b55d21cd5e7cc19d95f89407b"
server_key_iv: "5f84efb354f9fa639270e9e9b041578c"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.475677 28731 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 01:41:37.478627 28758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:37.479943 28731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:41:37.480242 28731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "c7bbc0a5e85d4e3da44507e8a8648d93"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "d9acd90b55d21cd5e7cc19d95f89407b"
server_key_iv: "5f84efb354f9fa639270e9e9b041578c"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.480368 28731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:37.493289 28731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:37.496460 28731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:37.496680 28731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:37.504168 28731 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:36185
I20260810 01:41:37.504467 28836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:36185 every 8 connection(s)
I20260810 01:41:37.505215 28731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:37.506574 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28731
I20260810 01:41:37.506726 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:37.507033 25398 external_mini_cluster.cc:1428] Setting key f386f3217ff836ffcde633f375a36a51
I20260810 01:41:37.508263 28837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:37.512725 28837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.205.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.189@KRBTEST.COM" created.
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:37.530084 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.515051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:36185 (local address 127.0.0.1:33204)
0810 01:41:37.515553 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.515607 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:37.516560 (+ 953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:37.517324 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:37.517329 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:37.517832 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:37.518100 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.518114 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.519303 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.519306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.520268 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.520278 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.521216 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.521219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.521336 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.522020 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:37.522047 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:37.524152 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:37.526890 (+ 2738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.526899 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.526908 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.527156 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.527607 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.527609 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.527611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.527724 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.528599 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:37.528605 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:37.528752 (+ 147us) client_negotiation.cc:769] Sending connection context
0810 01:41:37.528906 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:41:37.529229 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":5,"thread_start_us":138,"threads_started":1}
I20260810 01:41:37.530090 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.515052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33204 (local address 127.24.205.190:36185)
0810 01:41:37.515679 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:37.515694 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:37.515746 (+ 52us) server_negotiation.cc:407] Connection header received
0810 01:41:37.516924 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:37.516930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:37.517122 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:37.517297 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:37.518254 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.519180 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.520391 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.521052 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.521307 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.524337 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:37.524347 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:37.524366 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:37.524399 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:37.526749 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.527302 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.527312 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.527316 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.527483 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.527836 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.527839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.527841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.528440 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:37.528620 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:37.529053 (+ 433us) server_negotiation.cc:299] Negotiation successful
0810 01:41:37.529370 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":155,"server-negotiator.queue_time_us":491,"spinlock_wait_cycles":3456,"thread_start_us":187,"threads_started":1}
I20260810 01:41:37.532765 28837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:37.533564 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.533276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44922)
0810 01:41:37.533407 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.533482 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 01:41:37.533787 28760 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
I20260810 01:41:37.534693 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.534492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44934)
0810 01:41:37.534595 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.534640 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 01:41:37.534863 28837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:35035: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab.
Entry for principal kudu/127.24.205.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab.
I20260810 01:41:37.539510 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:35035
--webserver_interface=127.24.205.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab
--principal=kudu/127.24.205.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:37493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:36185,127.24.205.189:35035,127.24.205.188:33611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:41:37.584172 28837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } attempt: 1
I20260810 01:41:37.585179 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.584791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44940)
0810 01:41:37.584990 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.585071 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260810 01:41:37.585965 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.585736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44944)
0810 01:41:37.585845 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.585899 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 01:41:37.586104 28837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:35035: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
I20260810 01:41:37.654300 28837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } attempt: 2
I20260810 01:41:37.655308 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.654895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44958)
0810 01:41:37.655128 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.655211 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260810 01:41:37.656177 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.655897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44964)
0810 01:41:37.656014 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.656113 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 01:41:37.656834 28837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:35035: Network error: Client connection negotiation failed: client connection to 127.24.205.189:35035: connect: Connection refused (error 111)
W20260810 01:41:37.661422 28849 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:41:37.661689 28849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:37.661713 28849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:37.661757 28849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:37.665728 28849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:37.665778 28849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:37.665798 28849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:37.665814 28849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:37.665830 28849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:37.671128 28849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:36185,127.24.205.189:35035,127.24.205.188:33611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab
--principal=kudu/127.24.205.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:35035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.205.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:37.672173 28849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:37.673184 28849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:37.681766 28857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:37.681761 28856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:37.681779 28860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:37.682047 28849 server_base.cc:1034] running on GCE node
I20260810 01:41:37.682711 28849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:37.683892 28849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:37.685086 28849 hybrid_clock.cc:648] HybridClock initialized: now 1786326097685076 us; error 33 us; skew 500 ppm
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:37.692687 28849 init.cc:377] Logged in from keytab as kudu/127.24.205.189@KRBTEST.COM (short username kudu)
I20260810 01:41:37.693607 28849 webserver.cc:460] Webserver started at http://127.24.205.189:35571/ using document root <none> and password file <none>
I20260810 01:41:37.694141 28849 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:37.694201 28849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:37.694373 28849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:37.696491 28849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data/instance:
uuid: "fb01b6961d6342f4b953836b396590bf"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "3217844395a375784a84ca177096081a"
server_key_iv: "3ae3f3eed6e75bb27e5ea9e264207eee"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.697032 28849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/wal/instance:
uuid: "fb01b6961d6342f4b953836b396590bf"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "3217844395a375784a84ca177096081a"
server_key_iv: "3ae3f3eed6e75bb27e5ea9e264207eee"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.700788 28849 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:41:37.703195 28872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:37.704495 28849 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:37.704639 28849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/wal
uuid: "fb01b6961d6342f4b953836b396590bf"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "3217844395a375784a84ca177096081a"
server_key_iv: "3ae3f3eed6e75bb27e5ea9e264207eee"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.704746 28849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:37.723459 28849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:37.727072 28849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:37.727344 28849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:37.735910 28849 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.189:35035
I20260810 01:41:37.736255 28952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.189:35035 every 8 connection(s)
I20260810 01:41:37.737116 28849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
I20260810 01:41:37.737363 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28849
I20260810 01:41:37.737499 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-1/wal/instance
I20260810 01:41:37.737908 25398 external_mini_cluster.cc:1428] Setting key 183dae69bf895f5260aee03d5abc2230
I20260810 01:41:37.740839 28953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:37.745067 28953 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:37.748132 28837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } attempt: 3
WARNING: no policy specified for kudu/127.24.205.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.188@KRBTEST.COM" created.
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:37.760174 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.748579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44966)
0810 01:41:37.748762 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.748776 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:37.748867 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:37.749711 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:37.749715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:37.749922 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:37.750071 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.750081 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.751439 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.751442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.752043 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.752052 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.752926 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.752929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.753105 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.753666 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:37.753686 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:37.755268 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:37.757938 (+ 2670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.757941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.757943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.758216 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.758618 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.758622 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.758624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.758717 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.759440 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:37.759446 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:37.759578 (+ 132us) client_negotiation.cc:769] Sending connection context
0810 01:41:37.759711 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 01:41:37.759899 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260810 01:41:37.761083 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.747073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33214 (local address 127.24.205.190:36185)
0810 01:41:37.747271 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:37.747279 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:37.748434 (+ 1155us) server_negotiation.cc:407] Connection header received
0810 01:41:37.749300 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:37.749303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:37.749355 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:37.749444 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:37.750569 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.751329 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.752664 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.753918 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.754020 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.757197 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:37.757203 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:37.757207 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:37.757238 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:37.759078 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.759617 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.759620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.759622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.759734 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.760035 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.760039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.760040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.760278 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:37.760363 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:37.760802 (+ 439us) server_negotiation.cc:299] Negotiation successful
0810 01:41:37.760952 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 01:41:37.761397 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.748692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44966 (local address 127.24.205.189:35035)
0810 01:41:37.749085 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:37.749096 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:37.749138 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:41:37.749288 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:37.749293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:37.749534 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:37.749719 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:37.750177 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.751322 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.752201 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.752809 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.752927 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.755418 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:37.755425 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:37.755439 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:37.755471 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:37.757799 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.758356 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.758365 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.758372 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.758498 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.758818 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.758821 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.758823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.759315 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:37.759471 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:37.759882 (+ 411us) server_negotiation.cc:299] Negotiation successful
0810 01:41:37.760261 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":256,"thread_start_us":167,"threads_started":1}
I20260810 01:41:37.761618 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.747433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:36185 (local address 127.0.0.1:33214)
0810 01:41:37.747931 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.748009 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:37.749061 (+ 1052us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:37.749534 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:37.749552 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:37.750002 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:37.750409 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.750424 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.751481 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.751484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.752539 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.752557 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.754191 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.754198 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.754351 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.755010 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:37.755037 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:37.757037 (+ 2000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:37.759204 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.759212 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.759217 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.759503 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.759843 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.759846 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.759848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.759930 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.760428 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:37.760434 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:37.760545 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 01:41:37.761271 (+ 726us) client_negotiation.cc:240] Negotiation successful
0810 01:41:37.761457 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":63,"thread_start_us":145,"threads_started":1}
I20260810 01:41:37.763038 28953 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:37.763474 28837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:37.764326 28841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.763915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53908)
0810 01:41:37.764186 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.764249 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
I20260810 01:41:37.765390 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.764862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53914)
0810 01:41:37.765235 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.765291 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":100,"threads_started":1}
W20260810 01:41:37.765640 28837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:33611: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
I20260810 01:41:37.772574 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.763528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44972)
0810 01:41:37.763662 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.763677 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:37.763753 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:37.764043 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:37.764045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:37.764242 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:37.764326 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.764331 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.765107 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.765110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.765768 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.765778 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.766251 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.766255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.766343 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.766835 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:37.766848 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:37.769151 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:37.771028 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.771034 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.771037 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.771233 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.771508 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:37.771510 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:37.771512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:37.771593 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:37.771977 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:37.771979 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:37.772113 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 01:41:37.772246 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 01:41:37.772397 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 01:41:37.772580 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.763765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44972 (local address 127.24.205.189:35035)
0810 01:41:37.763885 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:37.763888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:37.763896 (+ 8us) server_negotiation.cc:407] Connection header received
0810 01:41:37.763918 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:37.763919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:37.763949 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:37.764030 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:37.764473 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.764966 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.765885 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.766133 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.766251 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.769290 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:37.769294 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:37.769297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:37.769324 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:37.770917 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.771329 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.771335 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.771337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.771411 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:37.771689 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:37.771692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:37.771694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:37.771876 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:37.771977 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:37.772293 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 01:41:37.772459 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":58}
I20260810 01:41:37.773500 28953 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:37.774238 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.773952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53930)
0810 01:41:37.774085 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.774175 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab.
Entry for principal kudu/127.24.205.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab.
W20260810 01:41:37.774909 28880 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
I20260810 01:41:37.775584 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:33611
--webserver_interface=127.24.205.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab
--principal=kudu/127.24.205.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:37493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:36185,127.24.205.189:35035,127.24.205.188:33611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:41:37.776026 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.775605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53940)
0810 01:41:37.775817 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.775896 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260810 01:41:37.776280 28953 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:33611: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
I20260810 01:41:37.796821 28837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } attempt: 1
I20260810 01:41:37.797714 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.797390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53944)
0810 01:41:37.797545 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.797632 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 01:41:37.798514 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.798294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53946)
0810 01:41:37.798406 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.798457 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 01:41:37.798702 28837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:33611: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
I20260810 01:41:37.825604 28953 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } attempt: 1
I20260810 01:41:37.826545 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.826202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53956)
0810 01:41:37.826374 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.826450 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 01:41:37.827301 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.827065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53962)
0810 01:41:37.827187 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.827239 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 01:41:37.827569 28953 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:33611: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
I20260810 01:41:37.873900 28837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } attempt: 2
I20260810 01:41:37.874761 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.874442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53964)
0810 01:41:37.874600 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.874676 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 01:41:37.875666 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.875305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53972)
0810 01:41:37.875527 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.875592 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260810 01:41:37.876626 28837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:33611: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
I20260810 01:41:37.895795 28953 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } attempt: 2
W20260810 01:41:37.896414 28966 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
I20260810 01:41:37.896670 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.896332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53974)
0810 01:41:37.896513 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.896584 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260810 01:41:37.896775 28966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:37.896840 28966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:37.896910 28966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 01:41:37.897406 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.897177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53986)
0810 01:41:37.897290 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.897342 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 01:41:37.897573 28953 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:33611: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
W20260810 01:41:37.901134 28966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:37.901191 28966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:37.901237 28966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:37.901276 28966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:37.901322 28966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:37.906752 28966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:37493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:36185,127.24.205.189:35035,127.24.205.188:33611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab
--principal=kudu/127.24.205.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:33611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.205.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:37.907944 28966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:37.909114 28966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:37.917682 28982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:37.917709 28973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:37.917785 28975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:37.918018 28966 server_base.cc:1034] running on GCE node
I20260810 01:41:37.918593 28966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:37.919770 28966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:37.920959 28966 hybrid_clock.cc:648] HybridClock initialized: now 1786326097920912 us; error 63 us; skew 500 ppm
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:37.924022 28966 init.cc:377] Logged in from keytab as kudu/127.24.205.188@KRBTEST.COM (short username kudu)
I20260810 01:41:37.925307 28966 webserver.cc:460] Webserver started at http://127.24.205.188:39481/ using document root <none> and password file <none>
I20260810 01:41:37.925911 28966 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:37.926007 28966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:37.926254 28966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:37.928412 28966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data/instance:
uuid: "c66326912be441f78c87f29b992fb88d"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "f55535a9690542321139152b85fba425"
server_key_iv: "b7639d796467ff7667ccafb407818cdb"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.929018 28966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/wal/instance:
uuid: "c66326912be441f78c87f29b992fb88d"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "f55535a9690542321139152b85fba425"
server_key_iv: "b7639d796467ff7667ccafb407818cdb"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.933095 28966 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:41:37.935811 28995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:37.937165 28966 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:37.937321 28966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/wal
uuid: "c66326912be441f78c87f29b992fb88d"
format_stamp: "Formatted at 2026-08-10 01:41:37 on dist-test-slave-t3q3"
server_key: "f55535a9690542321139152b85fba425"
server_key_iv: "b7639d796467ff7667ccafb407818cdb"
server_key_version: "encryptionkey@0"
I20260810 01:41:37.937448 28966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:37.973959 28966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:37.975826 28837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } attempt: 3
I20260810 01:41:37.976701 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.976391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:53996)
0810 01:41:37.976560 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.976621 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260810 01:41:37.977401 28966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:37.977495 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.977262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:54000)
0810 01:41:37.977366 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.977414 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 01:41:37.977617 28966 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260810 01:41:37.977653 28837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:33611: Network error: Client connection negotiation failed: client connection to 127.24.205.188:33611: connect: Connection refused (error 111)
I20260810 01:41:37.985905 28966 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.188:33611
I20260810 01:41:37.986264 29073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.188:33611 every 8 connection(s)
I20260810 01:41:37.987046 28966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
I20260810 01:41:37.988765 28953 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } attempt: 3
I20260810 01:41:37.991146 29077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:37.994417 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 28966
I20260810 01:41:37.994560 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786325801109519-25398-0/minicluster-data/master-2/wal/instance
I20260810 01:41:37.994874 25398 external_mini_cluster.cc:1428] Setting key df7f1f83432f68183b133f01afd18e0f
I20260810 01:41:37.996088 29077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
I20260810 01:41:38.002476 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.989323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:54006)
0810 01:41:37.989485 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.989503 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:37.989614 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:37.991833 (+ 2219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:37.991836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:37.992043 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:37.992193 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.992201 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.993507 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.993511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.994320 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.994331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.995345 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.995348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:37.995436 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.995987 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:37.996004 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:37.997704 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:38.000324 (+ 2620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.000327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.000330 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.000588 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.000964 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.000967 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.000969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.001073 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.001868 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:38.001871 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:38.001973 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 01:41:38.002107 (+ 134us) client_negotiation.cc:240] Negotiation successful
0810 01:41:38.002257 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
Aug 10 01:41:37 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:38.004237 29080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.990017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54006 (local address 127.24.205.188:33611)
0810 01:41:37.990398 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:37.990414 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:37.990450 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:41:37.991167 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:37.991184 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:37.991557 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:37.991835 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:37.992337 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.993368 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.994460 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.995197 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.995407 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:37.997889 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:37.997893 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:37.997906 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:37.997931 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.000202 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.000693 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.000700 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.000706 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.000851 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.001188 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.001193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.001195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.001758 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.001903 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.002914 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.003202 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":106,"threads_started":1}
I20260810 01:41:38.007602 29081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.995684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54016 (local address 127.24.205.188:33611)
0810 01:41:37.996038 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:37.996049 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:37.996394 (+ 345us) server_negotiation.cc:407] Connection header received
0810 01:41:37.996514 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:37.996517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:37.996567 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:37.996660 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:37.997674 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.998491 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.999588 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:37.999891 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:37.999992 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.002871 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.002875 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.002877 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.002902 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.005758 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.006283 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.006287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.006288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.006386 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.006676 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.006681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.006683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.006866 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.007059 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.007270 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.007380 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"spinlock_wait_cycles":3456,"thread_start_us":163,"threads_started":1}
I20260810 01:41:38.008101 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.998381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33216 (local address 127.24.205.190:36185)
0810 01:41:37.998513 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:37.998518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:37.998533 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:41:37.998696 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:37.998701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:37.998762 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:37.998818 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:37.999830 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.000603 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.001605 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.001944 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.002070 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.004516 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.004520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.004523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.004552 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.006117 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.006618 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.006622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.006624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.006715 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.007066 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.007069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.007071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.007277 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.007350 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.007800 (+ 450us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.007931 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:41:38.008606 29086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:37.997881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:36185 (local address 127.0.0.1:33216)
0810 01:41:37.998402 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:37.998455 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:37.998565 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:37.999008 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:37.999013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:37.999563 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:37.999692 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:37.999700 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.000733 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.000736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.001475 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:38.001484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.002071 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.002078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.002188 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.002751 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:38.002769 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:38.004352 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:38.006213 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.006222 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.006230 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.006509 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.006832 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.006835 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.006839 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.006947 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.007435 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:38.007442 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:38.007566 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 01:41:38.008256 (+ 690us) client_negotiation.cc:240] Negotiation successful
0810 01:41:38.008434 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"spinlock_wait_cycles":768,"thread_start_us":89,"threads_started":1}
I20260810 01:41:38.009279 28953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: Bootstrap starting.
I20260810 01:41:38.011554 28953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:38.012282 29077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:38.012544 28953 log.cc:824] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:41:38 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:38.014900 28953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: No bootstrap required, opened a new log
Aug 10 01:41:38 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
I20260810 01:41:38.018419 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.009107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33232 (local address 127.24.205.190:36185)
0810 01:41:38.009220 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.009223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.009234 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:41:38.009266 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.009270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.009308 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.009396 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.010003 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.010479 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.011241 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.011486 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.011595 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.014844 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.014848 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.014851 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.014875 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.016677 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.017173 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.017178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.017180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.017272 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.017566 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.017569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.017571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.017750 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.017981 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.018119 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.018244 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:41:38.019037 28953 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
I20260810 01:41:38.019285 28953 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb01b6961d6342f4b953836b396590bf, State: Initialized, Role: FOLLOWER
I20260810 01:41:38.019675 28953 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
I20260810 01:41:38.020279 29088 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.020424 29088 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:38.021216 28953 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:38.021780 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.012995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44984 (local address 127.24.205.189:35035)
0810 01:41:38.013115 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.013120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.013133 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:41:38.013168 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.013170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.013205 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.013290 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.013769 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.014255 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.015356 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.015689 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.015801 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.018349 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.018352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.018355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.018379 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.020137 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.020624 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.020628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.020630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.020717 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.021008 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.021011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.021012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.021202 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.021281 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.021576 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.021680 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 01:41:38.021837 29086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.012744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:35035 (local address 127.0.0.1:44984)
0810 01:41:38.012873 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:38.012892 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:38.012969 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:38.013335 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:38.013339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:38.013505 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:38.013644 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:38.013652 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.014363 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.014370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.015001 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:38.015014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.015807 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.015811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.015898 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.016808 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:38.016819 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:38.018197 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:38.020260 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.020263 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.020265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.020496 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.020827 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.020830 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.020832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.020921 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.021309 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:38.021311 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:38.021406 (+ 95us) client_negotiation.cc:769] Sending connection context
0810 01:41:38.021520 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 01:41:38.021671 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 01:41:38.022768 29077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } has no permanent_uuid. Determining permanent_uuid...
W20260810 01:41:38.027361 29108 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:38.027436 29108 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 01:41:38 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
Aug 10 01:41:38 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
I20260810 01:41:38.025274 28849 master_runner.cc:186] Error getting master registration for 127.24.205.190:36185: OK, instance_id { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" instance_seqno: 1786326097502199 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:41:38.029112 28849 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:41:38.032688 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.020522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44996 (local address 127.24.205.189:35035)
0810 01:41:38.021963 (+ 1441us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.021969 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.021985 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:41:38.022022 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.022024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.022060 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.022128 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.022984 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.023694 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.025131 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.025442 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.025518 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.029386 (+ 3868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.029390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.029392 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.029415 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.030928 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.031362 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.031365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.031367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.031453 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.031743 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.031748 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.031749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.031925 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.032176 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.032384 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.032498 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1371,"thread_start_us":101,"threads_started":1}
I20260810 01:41:38.032707 29086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.023254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:54030)
0810 01:41:38.023449 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:38.023461 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:38.023524 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:38.024113 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:38.024116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:38.024274 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:38.024357 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:38.024363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.025290 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.025293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.026001 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:38.026013 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.026679 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.026684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.026786 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.027209 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:38.027223 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:38.029142 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:38.031075 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.031078 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.031080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.031320 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.031592 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.031595 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.031597 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.031679 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.032223 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:38.032225 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:38.032308 (+ 83us) client_negotiation.cc:769] Sending connection context
0810 01:41:38.032411 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 01:41:38.032538 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260810 01:41:38.033190 29081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.023473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54030 (local address 127.24.205.188:33611)
0810 01:41:38.023850 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.023855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.023870 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:41:38.023904 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.023910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.023954 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.024032 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.024482 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.025181 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.026146 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.026459 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.026559 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.029272 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.029275 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.029278 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.029298 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.030945 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.031422 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.031424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.031426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.031501 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.031771 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.031776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.031778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.032034 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.032188 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.032905 (+ 717us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.033035 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300}
I20260810 01:41:38.036391 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:38.036413 29077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: Bootstrap starting.
I20260810 01:41:38.038708 29077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:38.037935 28798 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33232
I20260810 01:41:38.039476 29077 log.cc:824] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:38.041795 29077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: No bootstrap required, opened a new log
I20260810 01:41:38.045822 29077 raft_consensus.cc:348] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
I20260810 01:41:38.046069 29077 raft_consensus.cc:729] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66326912be441f78c87f29b992fb88d, State: Initialized, Role: FOLLOWER
I20260810 01:41:38.046396 29077 consensus_queue.cc:260] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
I20260810 01:41:38.046870 29113 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.047022 29113 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:38.047688 29077 sys_catalog.cc:564] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [sys.catalog]: configured and running, proceeding with master startup.
W20260810 01:41:38.052969 29128 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:38.053074 29128 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:38.051550 28966 master_runner.cc:186] Error getting master registration for 127.24.205.190:36185: OK, instance_id { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" instance_seqno: 1786326097502199 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:41:38.054307 28966 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:41:38.141813 28837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } attempt: 4
Aug 10 01:41:38 dist-test-slave-t3q3 krb5kdc[28713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326097, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
I20260810 01:41:38.153224 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.142452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:33611 (local address 127.0.0.1:54036)
0810 01:41:38.142788 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:38.142804 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:38.142913 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:38.143223 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:38.143226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:38.143471 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:38.143642 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:38.143650 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.144762 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.144765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.145691 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:38.145703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.146340 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.146344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:38.146476 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.147107 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:38.147122 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:38.149014 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:38.151238 (+ 2224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.151242 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.151244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.151557 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.151858 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:38.151862 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:38.151864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:38.151975 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:38.152588 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:38.152591 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:38.152717 (+ 126us) client_negotiation.cc:769] Sending connection context
0810 01:41:38.152833 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 01:41:38.153025 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239}
I20260810 01:41:38.153805 29081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.142812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54036 (local address 127.24.205.188:33611)
0810 01:41:38.142945 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.142949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.143000 (+ 51us) server_negotiation.cc:407] Connection header received
0810 01:41:38.143052 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.143055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.143111 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.143202 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.143801 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.144633 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.145835 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.146220 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.146385 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.149156 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.149160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.149163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.149194 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.151103 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.151656 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.151660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.151662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.151747 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.152133 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.152137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.152139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.152401 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.152487 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.153490 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.153644 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:41:38.157276 28837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93: Bootstrap starting.
I20260810 01:41:38.160231 28837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:38.161188 28837 log.cc:824] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:38.163641 28837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93: No bootstrap required, opened a new log
I20260810 01:41:38.167558 28837 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
I20260810 01:41:38.167874 28837 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7bbc0a5e85d4e3da44507e8a8648d93, State: Initialized, Role: FOLLOWER
I20260810 01:41:38.168306 28837 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
I20260810 01:41:38.169034 29133 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.169265 29133 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:38.169946 28837 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:38.170032 28798 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:41:38.170166 28798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:38.171463 28798 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
I20260810 01:41:38.173288 28913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fb01b6961d6342f4b953836b396590bf"
I20260810 01:41:38.173345 29034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c66326912be441f78c87f29b992fb88d"
I20260810 01:41:38.173554 28913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:38.173590 29034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:38.174820 29034 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bbc0a5e85d4e3da44507e8a8648d93 in term 1.
I20260810 01:41:38.174839 28913 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7bbc0a5e85d4e3da44507e8a8648d93 in term 1.
I20260810 01:41:38.175488 28760 leader_election.cc:302] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7bbc0a5e85d4e3da44507e8a8648d93, fb01b6961d6342f4b953836b396590bf; no voters:
I20260810 01:41:38.172503 28798 leader_election.cc:288] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [CANDIDATE]: Term 1 election: Requested vote from peers fb01b6961d6342f4b953836b396590bf (127.24.205.189:35035), c66326912be441f78c87f29b992fb88d (127.24.205.188:33611)
I20260810 01:41:38.177620 29133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:38.177836 29133 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [term 1 LEADER]: Becoming Leader. State: Replica: c7bbc0a5e85d4e3da44507e8a8648d93, State: Running, Role: LEADER
I20260810 01:41:38.178200 29133 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } }
W20260810 01:41:38.179332 29157 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:38.179414 29157 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:38.180173 29133 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7bbc0a5e85d4e3da44507e8a8648d93. Latest consensus state: current_term: 1 leader_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.180277 29133 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:38.182497 28731 master_runner.cc:263] No leader master found from master c7bbc0a5e85d4e3da44507e8a8648d93
I20260810 01:41:38.182561 28731 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:41:38.184319 29169 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:38.188881 29169 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:38.194924 29034 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [term 1 FOLLOWER]: Refusing update from remote peer c7bbc0a5e85d4e3da44507e8a8648d93: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:38.195871 29133 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:38.197089 28913 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [term 1 FOLLOWER]: Refusing update from remote peer c7bbc0a5e85d4e3da44507e8a8648d93: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:38.197901 29166 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:38.200207 29113 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7bbc0a5e85d4e3da44507e8a8648d93. Latest consensus state: current_term: 1 leader_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.200342 29113 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:38.201519 29088 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7bbc0a5e85d4e3da44507e8a8648d93. Latest consensus state: current_term: 1 leader_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.201632 29088 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:38.212399 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.184813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45000 (local address 127.24.205.189:35035)
0810 01:41:38.184932 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.184936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.202428 (+ 17492us) server_negotiation.cc:407] Connection header received
0810 01:41:38.202585 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.202588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.202636 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.202691 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.203725 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.204485 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.205792 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.206120 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.206227 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.208247 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.208251 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.208254 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.208282 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.210220 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.210754 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.210759 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.210761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.210854 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.211216 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.211225 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.211229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.211498 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.211625 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.212049 (+ 424us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.212216 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:41:38.216388 29081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.180859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54044 (local address 127.24.205.188:33611)
0810 01:41:38.180987 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.180994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.192429 (+ 11435us) server_negotiation.cc:407] Connection header received
0810 01:41:38.193085 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.193090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.193149 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.193206 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.194357 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.195241 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.201317 (+ 6076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.201642 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.201726 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.212578 (+ 10852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.212582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.212585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.212619 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.214409 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.214914 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.214917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.214919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.215005 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.215336 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.215340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.215341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.215567 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.215712 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.216113 (+ 401us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.216239 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:41:38.217060 29176 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.217245 29176 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:38.217442 29173 mvcc.cc:205] Tried to move back new op lower bound from 7316791698197688320 to 7316791698141933568. Current Snapshot: MvccSnapshot[applied={T|T < 7316791698197688320}]
I20260810 01:41:38.218531 29169 catalog_manager.cc:1347] Generated new cluster ID: a441631a4c484ea79371a22b19ef10e9
I20260810 01:41:38.218598 29169 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:38.218717 29088 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.218819 29088 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:38.220449 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:38.181436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33240 (local address 127.24.205.190:36185)
0810 01:41:38.182300 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.182308 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.202088 (+ 19780us) server_negotiation.cc:407] Connection header received
0810 01:41:38.202234 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.202237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.202289 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.202366 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.203324 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.203974 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.205838 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:38.206183 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:38.206249 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:38.210202 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:38.210207 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:38.210209 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:38.210237 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:38.212009 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.214397 (+ 2388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.214400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.214402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.214497 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:38.219444 (+ 4947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:38.219450 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:38.219452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:38.219686 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:38.219806 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:38.220219 (+ 413us) server_negotiation.cc:299] Negotiation successful
0810 01:41:38.220348 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779}
I20260810 01:41:38.222869 29166 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.223011 29166 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:38.223681 29113 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7bbc0a5e85d4e3da44507e8a8648d93" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 36185 } } peers { permanent_uuid: "fb01b6961d6342f4b953836b396590bf" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 35035 } } peers { permanent_uuid: "c66326912be441f78c87f29b992fb88d" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 33611 } } }
I20260810 01:41:38.223804 29113 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:38.224995 29177 mvcc.cc:205] Tried to move back new op lower bound from 7316791698197688320 to 7316791698141933568. Current Snapshot: MvccSnapshot[applied={T|T < 7316791698197688320}]
I20260810 01:41:38.230410 29169 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:38.231653 29169 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:38.243407 29169 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7bbc0a5e85d4e3da44507e8a8648d93: Generated new TSK 0
I20260810 01:41:38.244254 29169 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:41:38.271260 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.269717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45006 (local address 127.24.205.189:35035)
0810 01:41:38.269849 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.269855 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.270027 (+ 172us) server_negotiation.cc:407] Connection header received
0810 01:41:38.270265 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.270269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.270327 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.270387 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.271089 (+ 702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45006: BlockingRecv error: recv got EOF from 127.0.0.1:45006 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 01:41:38.271875 28844 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.269368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33246 (local address 127.24.205.190:36185)
0810 01:41:38.269499 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.269504 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.270797 (+ 1293us) server_negotiation.cc:407] Connection header received
0810 01:41:38.270998 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.271002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.271058 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.271120 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.271748 (+ 628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33246: BlockingRecv error: recv got EOF from 127.0.0.1:33246 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 01:41:38.272753 29081 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.270139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54052 (local address 127.24.205.188:33611)
0810 01:41:38.270264 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.270268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.271781 (+ 1513us) server_negotiation.cc:407] Connection header received
0810 01:41:38.272040 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.272043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.272115 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.272177 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.272642 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54052: BlockingRecv error: recv got EOF from 127.0.0.1:54052 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 01:41:38.275692 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.274497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45018 (local address 127.24.205.189:35035)
0810 01:41:38.274619 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.274623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.274919 (+ 296us) server_negotiation.cc:407] Connection header received
0810 01:41:38.275049 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.275051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.275111 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.275203 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.275592 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45018: BlockingRecv error: recv got EOF from 127.0.0.1:45018 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 01:41:38.279495 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.278708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45024 (local address 127.24.205.189:35035)
0810 01:41:38.278826 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.278830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.278844 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:41:38.278887 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.278890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.278936 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.279025 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.279406 (+ 381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45024: BlockingRecv error: recv got EOF from 127.0.0.1:45024 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260810 01:41:38.284052 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.283138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45036 (local address 127.24.205.189:35035)
0810 01:41:38.283251 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.283255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.283391 (+ 136us) server_negotiation.cc:407] Connection header received
0810 01:41:38.283473 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.283476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.283522 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.283603 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.283961 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45036: BlockingRecv error: recv got EOF from 127.0.0.1:45036 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260810 01:41:38.290776 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.289771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45050 (local address 127.24.205.189:35035)
0810 01:41:38.289921 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.289924 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.289993 (+ 69us) server_negotiation.cc:407] Connection header received
0810 01:41:38.290139 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.290141 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.290181 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.290245 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.290678 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45050: BlockingRecv error: recv got EOF from 127.0.0.1:45050 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260810 01:41:38.302176 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.300969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45058 (local address 127.24.205.189:35035)
0810 01:41:38.301173 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.301177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.301272 (+ 95us) server_negotiation.cc:407] Connection header received
0810 01:41:38.301415 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.301418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.301466 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.301540 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.302044 (+ 504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45058: BlockingRecv error: recv got EOF from 127.0.0.1:45058 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
W20260810 01:41:38.321437 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.320267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45074 (local address 127.24.205.189:35035)
0810 01:41:38.320409 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.320414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.320602 (+ 188us) server_negotiation.cc:407] Connection header received
0810 01:41:38.320710 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.320714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.320772 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.320868 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.321326 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45074: BlockingRecv error: recv got EOF from 127.0.0.1:45074 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 01:41:38.356899 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.355650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45080 (local address 127.24.205.189:35035)
0810 01:41:38.355786 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.355791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.355953 (+ 162us) server_negotiation.cc:407] Connection header received
0810 01:41:38.356118 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.356121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.356181 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.356282 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.356774 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45080: BlockingRecv error: recv got EOF from 127.0.0.1:45080 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 01:41:38.424485 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.423203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45094 (local address 127.24.205.189:35035)
0810 01:41:38.423371 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.423377 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.423578 (+ 201us) server_negotiation.cc:407] Connection header received
0810 01:41:38.423696 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.423699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.423750 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.423825 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.424341 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45094: BlockingRecv error: recv got EOF from 127.0.0.1:45094 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260810 01:41:38.556030 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.554673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.24.205.189:35035)
0810 01:41:38.554813 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.554816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.555007 (+ 191us) server_negotiation.cc:407] Connection header received
0810 01:41:38.555197 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.555200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.555249 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.555343 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.555856 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45096: BlockingRecv error: recv got EOF from 127.0.0.1:45096 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 01:41:38.815728 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:38.814405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45098 (local address 127.24.205.189:35035)
0810 01:41:38.814563 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:38.814568 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:38.814749 (+ 181us) server_negotiation.cc:407] Connection header received
0810 01:41:38.814876 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:38.814879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:38.814942 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:38.815037 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:38.815585 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45098: BlockingRecv error: recv got EOF from 127.0.0.1:45098 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 01:41:39.028817 29108 catalog_manager.cc:1259] Loaded cluster ID: a441631a4c484ea79371a22b19ef10e9
I20260810 01:41:39.028906 29108 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: loading cluster ID for follower catalog manager: success
I20260810 01:41:39.030506 29108 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: acquiring CA information for follower catalog manager: success
I20260810 01:41:39.031633 29108 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fb01b6961d6342f4b953836b396590bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:41:39.054241 29128 catalog_manager.cc:1259] Loaded cluster ID: a441631a4c484ea79371a22b19ef10e9
I20260810 01:41:39.054332 29128 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: loading cluster ID for follower catalog manager: success
I20260810 01:41:39.055994 29128 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: acquiring CA information for follower catalog manager: success
I20260810 01:41:39.057168 29128 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c66326912be441f78c87f29b992fb88d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:41:39.334198 29291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:39.329976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45104 (local address 127.24.205.189:35035)
0810 01:41:39.330231 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:39.330237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:39.330335 (+ 98us) server_negotiation.cc:407] Connection header received
0810 01:41:39.330524 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:39.330528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:39.330659 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:39.330784 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:39.331069 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.331602 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.332593 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.332847 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.332960 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:39.333322 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:39.333783 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:39.333932 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:39.333970 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 01:41:39.334026 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":76,"threads_started":1}
I20260810 01:41:39.341181 29300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:39.337660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54068 (local address 127.24.205.188:33611)
0810 01:41:39.337880 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:39.337883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:39.337896 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:41:39.338005 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:39.338007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:39.338135 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:39.338239 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:39.338443 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.338955 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.339753 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.339973 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.340051 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:39.340371 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:39.340804 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:39.340948 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:39.341005 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 01:41:39.341059 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":84,"threads_started":1}
I20260810 01:41:39.349161 29291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:39.344592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45114 (local address 127.24.205.189:35035)
0810 01:41:39.344734 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:39.344739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:39.345640 (+ 901us) server_negotiation.cc:407] Connection header received
0810 01:41:39.345834 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:39.345838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:39.345896 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:39.345975 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:39.346235 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.346905 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.347798 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.348114 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.348215 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:39.348539 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:39.348655 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:39.348705 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:39.348948 (+ 243us) server_negotiation.cc:299] Negotiation successful
0810 01:41:39.349017 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:41:39.349177 29300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:39.344413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54070 (local address 127.24.205.188:33611)
0810 01:41:39.344538 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:39.344542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:39.345099 (+ 557us) server_negotiation.cc:407] Connection header received
0810 01:41:39.345216 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:39.345218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:39.345258 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:39.345347 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:39.345727 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.346397 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.347931 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.348287 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.348382 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:39.348720 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:39.348799 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:39.348845 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:39.349026 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 01:41:39.349076 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:41:39.350474 29308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:39.344361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33248 (local address 127.24.205.190:36185)
0810 01:41:39.344844 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:39.344871 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:39.344888 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:41:39.344998 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:39.345002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:39.345189 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:39.345305 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:39.345647 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.346429 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.348339 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:39.348706 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:39.348846 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:39.349296 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:39.349715 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:39.349811 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:39.350259 (+ 448us) server_negotiation.cc:299] Negotiation successful
0810 01:41:39.350319 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":75,"threads_started":1}
I20260810 01:41:39.353427 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28731
I20260810 01:41:39.378415 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28849
I20260810 01:41:39.390103 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 28966
2026-08-10T01:41:39Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3461 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:39 dist-test-slave-t3q3 krb5kdc[29316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:39 dist-test-slave-t3q3 krb5kdc[29316](info): set up 2 sockets
Aug 10 01:41:39 dist-test-slave-t3q3 krb5kdc[29316](info): commencing operation
krb5kdc: starting...
W20260810 01:41:40.653468 25398 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/test-user.keytab.
Aug 10 01:41:40 dist-test-slave-t3q3 krb5kdc[29316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.205.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
Entry for principal kudu/127.24.205.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab.
I20260810 01:41:40.782804 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42155
--webserver_interface=127.24.205.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:34797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:42155,127.24.205.189:36265,127.24.205.188:35257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:40.897389 29338 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:41:40.897712 29338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:40.897764 29338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:40.897836 29338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:40.901868 29338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:40.901952 29338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:40.901991 29338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:40.902029 29338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:40.902067 29338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:40.907219 29338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:34797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:42155,127.24.205.189:36265,127.24.205.188:35257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.190.keytab
--principal=kudu/127.24.205.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.190:42155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.205.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:40.908326 29338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:40.909353 29338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:40.917973 29354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:40.918198 29338 server_base.cc:1034] running on GCE node
W20260810 01:41:40.918010 29347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:40.917985 29345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:40.918951 29338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:40.920152 29338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:40.921341 29338 hybrid_clock.cc:648] HybridClock initialized: now 1786326100921317 us; error 49 us; skew 500 ppm
Aug 10 01:41:40 dist-test-slave-t3q3 krb5kdc[29316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:40.924310 29338 init.cc:377] Logged in from keytab as kudu/127.24.205.190@KRBTEST.COM (short username kudu)
I20260810 01:41:40.925217 29338 webserver.cc:460] Webserver started at http://127.24.205.190:36467/ using document root <none> and password file <none>
I20260810 01:41:40.925798 29338 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:40.925891 29338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:40.926138 29338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:40.928278 29338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data/instance:
uuid: "6b4d2f6a99444f0da6615a7b876cacce"
format_stamp: "Formatted at 2026-08-10 01:41:40 on dist-test-slave-t3q3"
server_key: "0110398c25109f6bc67ff83adaf67d25"
server_key_iv: "c4045fe360bc7b660133811cbf6ece3e"
server_key_version: "encryptionkey@0"
I20260810 01:41:40.928861 29338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/wal/instance:
uuid: "6b4d2f6a99444f0da6615a7b876cacce"
format_stamp: "Formatted at 2026-08-10 01:41:40 on dist-test-slave-t3q3"
server_key: "0110398c25109f6bc67ff83adaf67d25"
server_key_iv: "c4045fe360bc7b660133811cbf6ece3e"
server_key_version: "encryptionkey@0"
I20260810 01:41:40.932595 29338 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:41:40.935022 29369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:40.936302 29338 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:40.936437 29338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/wal
uuid: "6b4d2f6a99444f0da6615a7b876cacce"
format_stamp: "Formatted at 2026-08-10 01:41:40 on dist-test-slave-t3q3"
server_key: "0110398c25109f6bc67ff83adaf67d25"
server_key_iv: "c4045fe360bc7b660133811cbf6ece3e"
server_key_version: "encryptionkey@0"
I20260810 01:41:40.936553 29338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:40.962280 29338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:40.965744 29338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:40.965961 29338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:40.973429 29338 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.190:42155
I20260810 01:41:40.973690 29458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.190:42155 every 8 connection(s)
I20260810 01:41:40.974465 29338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:40.977406 29459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:40.979846 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 29338
I20260810 01:41:40.979986 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-0/wal/instance
I20260810 01:41:40.980327 25398 external_mini_cluster.cc:1428] Setting key 2b3a13a60f3ab541ec55d210f0dc570f
I20260810 01:41:40.981272 29459 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.205.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.189@KRBTEST.COM" created.
Aug 10 01:41:40 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:40.998764 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:40.983661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42155 (local address 127.0.0.1:49736)
0810 01:41:40.984271 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:40.984307 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:40.985116 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:40.985804 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:40.985810 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:40.986263 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:40.986491 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:40.986504 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:40.987653 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:40.987661 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:40.988450 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:40.988460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:40.989107 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:40.989111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:40.989206 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:40.989857 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:40.989873 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:40.993322 (+ 3449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:40.995799 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:40.995808 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:40.995817 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:40.996043 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:40.996472 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:40.996474 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:40.996476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:40.996587 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:40.997448 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:40.997453 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:40.997581 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 01:41:40.997728 (+ 147us) client_negotiation.cc:240] Negotiation successful
0810 01:41:40.997975 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"spinlock_wait_cycles":19200,"thread_start_us":151,"threads_started":1}
I20260810 01:41:40.998769 29463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:40.983660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49736 (local address 127.24.205.190:42155)
0810 01:41:40.984112 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:40.984153 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:40.984418 (+ 265us) server_negotiation.cc:407] Connection header received
0810 01:41:40.985431 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:40.985436 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:40.985618 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:40.985805 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:40.986644 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:40.987517 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:40.988569 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:40.988947 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:40.989121 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:40.993503 (+ 4382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:40.993509 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:40.993519 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:40.993543 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:40.995664 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:40.996205 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:40.996214 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:40.996216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:40.996369 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:40.996696 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:40.996702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:40.996707 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:40.997315 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:40.997474 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:40.997882 (+ 408us) server_negotiation.cc:299] Negotiation successful
0810 01:41:40.998068 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"spinlock_wait_cycles":768,"thread_start_us":153,"threads_started":1}
I20260810 01:41:41.001574 29459 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:41.002354 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.002103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44242)
0810 01:41:41.002229 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.002298 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260810 01:41:41.002540 29372 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
I20260810 01:41:41.003445 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.003221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44248)
0810 01:41:41.003326 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.003379 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 01:41:41.003595 29459 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:36265: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab.
Entry for principal kudu/127.24.205.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab.
I20260810 01:41:41.011026 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:36265
--webserver_interface=127.24.205.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab
--principal=kudu/127.24.205.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:34797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:42155,127.24.205.189:36265,127.24.205.188:35257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:41:41.052845 29459 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } attempt: 1
I20260810 01:41:41.053748 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.053432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44256)
0810 01:41:41.053587 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.053669 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 01:41:41.054592 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.054394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44272)
0810 01:41:41.054498 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.054543 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 01:41:41.054824 29459 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:36265: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
I20260810 01:41:41.123035 29459 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } attempt: 2
I20260810 01:41:41.123908 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.123599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44282)
0810 01:41:41.123763 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.123831 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 01:41:41.124675 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.124487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44292)
0810 01:41:41.124578 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.124624 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 01:41:41.124823 29459 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.189:36265: Network error: Client connection negotiation failed: client connection to 127.24.205.189:36265: connect: Connection refused (error 111)
W20260810 01:41:41.125439 29472 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:41:41.125679 29472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:41.125707 29472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:41.125746 29472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:41.129762 29472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:41.129814 29472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:41.129833 29472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:41.129850 29472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:41.129865 29472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:41.134934 29472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:34797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:42155,127.24.205.189:36265,127.24.205.188:35257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.189.keytab
--principal=kudu/127.24.205.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.189:36265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.205.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:41.135849 29472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:41.136924 29472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:41.145403 29483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:41.145430 29481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:41.145427 29480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:41.145650 29472 server_base.cc:1034] running on GCE node
I20260810 01:41:41.146292 29472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:41.147313 29472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:41.148501 29472 hybrid_clock.cc:648] HybridClock initialized: now 1786326101148488 us; error 26 us; skew 500 ppm
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:41.151182 29472 init.cc:377] Logged in from keytab as kudu/127.24.205.189@KRBTEST.COM (short username kudu)
I20260810 01:41:41.152134 29472 webserver.cc:460] Webserver started at http://127.24.205.189:42509/ using document root <none> and password file <none>
I20260810 01:41:41.152640 29472 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:41.152699 29472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:41.152858 29472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:41.154793 29472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data/instance:
uuid: "fec9ca515d294693b33eef1dc0e61b16"
format_stamp: "Formatted at 2026-08-10 01:41:41 on dist-test-slave-t3q3"
server_key: "a7e84e2558036bbba024c6e78d606fa8"
server_key_iv: "7a954beb35fcb6f467a46822cff852e9"
server_key_version: "encryptionkey@0"
I20260810 01:41:41.155303 29472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/wal/instance:
uuid: "fec9ca515d294693b33eef1dc0e61b16"
format_stamp: "Formatted at 2026-08-10 01:41:41 on dist-test-slave-t3q3"
server_key: "a7e84e2558036bbba024c6e78d606fa8"
server_key_iv: "7a954beb35fcb6f467a46822cff852e9"
server_key_version: "encryptionkey@0"
I20260810 01:41:41.158867 29472 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:41:41.161139 29492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:41.162272 29472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:41.162381 29472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/wal
uuid: "fec9ca515d294693b33eef1dc0e61b16"
format_stamp: "Formatted at 2026-08-10 01:41:41 on dist-test-slave-t3q3"
server_key: "a7e84e2558036bbba024c6e78d606fa8"
server_key_iv: "7a954beb35fcb6f467a46822cff852e9"
server_key_version: "encryptionkey@0"
I20260810 01:41:41.162461 29472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:41.176034 29472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:41.178707 29472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:41.178845 29472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:41.185899 29472 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.189:36265
I20260810 01:41:41.186182 29573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.189:36265 every 8 connection(s)
I20260810 01:41:41.186854 29472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/data/info.pb
I20260810 01:41:41.187481 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 29472
I20260810 01:41:41.187618 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-1/wal/instance
I20260810 01:41:41.187929 25398 external_mini_cluster.cc:1428] Setting key 8dc2640f722941918a0eeccda74a4582
I20260810 01:41:41.190249 29574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:41.194041 29574 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.205.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.205.188@KRBTEST.COM" created.
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:41.208959 29463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.195890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49744 (local address 127.24.205.190:42155)
0810 01:41:41.196049 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.196054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.196874 (+ 820us) server_negotiation.cc:407] Connection header received
0810 01:41:41.197812 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.197815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.197866 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.197948 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.199125 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.199901 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.201617 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.201860 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.201978 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.204765 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.204768 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.204770 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.204794 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.206826 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.207435 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.207438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.207439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.207513 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.207896 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.207898 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.207899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.208114 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.208193 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.208696 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.208815 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 01:41:41.209780 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.196251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42155 (local address 127.0.0.1:49744)
0810 01:41:41.196704 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.196754 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.197619 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.198099 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.198105 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.198443 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.198987 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.199001 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.200039 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.200045 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.201486 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.201496 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.202013 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.202018 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.202200 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.202778 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.202794 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.204592 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.206951 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.206960 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.206977 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.207329 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.207606 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.207609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.207611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.207802 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.208205 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.208210 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.208460 (+ 250us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.208608 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.208936 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":133,"threads_started":1}
I20260810 01:41:41.211143 29574 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.205.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab.
Entry for principal kudu/127.24.205.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab.
I20260810 01:41:41.215494 25398 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
/tmp/dist-test-taskdl8Mys/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:35257
--webserver_interface=127.24.205.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab
--principal=kudu/127.24.205.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.205.148:34797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.205.190:42155,127.24.205.189:36265,127.24.205.188:35257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:41:41.216008 29459 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } attempt: 3
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
I20260810 01:41:41.222354 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.211617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44300)
0810 01:41:41.211738 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.211753 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.211823 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.212500 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.212503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.212667 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.212792 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.212798 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.213829 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.213832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.214460 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.214469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.215171 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.215174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.215254 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.215739 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.215751 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.217597 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.220352 (+ 2755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.220356 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.220359 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.220616 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.220977 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.220981 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.220984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.221064 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.221630 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.221635 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.221758 (+ 123us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.221899 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.222070 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 01:41:41.222787 29587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.211750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44300 (local address 127.24.205.189:36265)
0810 01:41:41.212096 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.212108 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.212135 (+ 27us) server_negotiation.cc:407] Connection header received
0810 01:41:41.212166 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.212171 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.212308 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.212522 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.212912 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.213670 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.214581 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.215030 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.215148 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.217740 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.217749 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.217763 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.217793 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.220229 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.220749 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.220758 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.220762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.220869 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.221168 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.221171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.221175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.221497 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.221630 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.222032 (+ 402us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.222195 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":110,"threads_started":1}
I20260810 01:41:41.224888 29574 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:41.225693 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.225367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47520)
0810 01:41:41.225514 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.225608 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 01:41:41.225726 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.216491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44308)
0810 01:41:41.216636 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.216655 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.216745 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.217137 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.217142 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.217343 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.217488 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.217498 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.218733 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.218737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.219298 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.219307 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.220076 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.220084 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.220226 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.220734 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.220754 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.222291 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.224312 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.224316 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.224318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.224518 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.224828 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.224831 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.224833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.224932 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.225315 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.225318 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.225420 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.225509 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.225612 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 01:41:41.226181 29493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
I20260810 01:41:41.226294 29588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.216565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44308 (local address 127.24.205.189:36265)
0810 01:41:41.216852 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.216861 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.216874 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:41:41.216908 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.216909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.216963 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.217616 (+ 653us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.217727 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.218603 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.219433 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.219882 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.220478 (+ 596us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.222463 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.222467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.222469 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.222492 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.224202 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.224616 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.224621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.224629 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.224720 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.225029 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.225031 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.225032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.225178 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.225910 (+ 732us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.225985 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.226102 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":85,"threads_started":1}
I20260810 01:41:41.227334 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.227065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47522)
0810 01:41:41.227194 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.227259 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 01:41:41.227329 29459 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } has no permanent_uuid. Determining permanent_uuid...
W20260810 01:41:41.227577 29574 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:35257: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
I20260810 01:41:41.227963 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.227711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47536)
0810 01:41:41.227871 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.227909 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260810 01:41:41.228744 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.228499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47552)
0810 01:41:41.228653 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.228695 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260810 01:41:41.228957 29459 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:35257: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
I20260810 01:41:41.260176 29459 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } attempt: 1
I20260810 01:41:41.261044 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.260739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47564)
0810 01:41:41.260906 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.260966 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 01:41:41.261760 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.261538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47578)
0810 01:41:41.261652 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.261704 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 01:41:41.261895 29459 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:35257: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
I20260810 01:41:41.276851 29574 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } attempt: 1
I20260810 01:41:41.277758 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.277434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47580)
0810 01:41:41.277598 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.277670 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 01:41:41.278570 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.278335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47596)
0810 01:41:41.278453 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.278507 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 01:41:41.278723 29574 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:35257: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
W20260810 01:41:41.332955 29589 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:41:41.333254 29589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:41.333278 29589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:41.333379 29589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 01:41:41.337061 29459 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } attempt: 2
W20260810 01:41:41.337508 29589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:41.337608 29589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:41.337653 29589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:41.337715 29589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:41.337739 29589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:41.338006 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.337619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47606)
0810 01:41:41.337837 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.337913 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 01:41:41.338866 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.338629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47610)
0810 01:41:41.338744 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.338801 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 01:41:41.339047 29459 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:35257: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
I20260810 01:41:41.343878 29589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.205.148:34797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.205.190:42155,127.24.205.189:36265,127.24.205.188:35257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/krb5kdc/kudu_127.24.205.188.keytab
--principal=kudu/127.24.205.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.205.188:35257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.205.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:41.345150 29589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:41.346383 29589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:41:41.346916 29574 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } attempt: 2
I20260810 01:41:41.347674 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.347372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47616)
0810 01:41:41.347524 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.347592 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 01:41:41.348472 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.348226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47628)
0810 01:41:41.348347 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.348403 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 01:41:41.348613 29574 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.205.188:35257: Network error: Client connection negotiation failed: client connection to 127.24.205.188:35257: connect: Connection refused (error 111)
W20260810 01:41:41.355399 29601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:41.355399 29600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:41.355413 29605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:41.355607 29589 server_base.cc:1034] running on GCE node
I20260810 01:41:41.356379 29589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:41.357502 29589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:41.358706 29589 hybrid_clock.cc:648] HybridClock initialized: now 1786326101358688 us; error 39 us; skew 500 ppm
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:41.361575 29589 init.cc:377] Logged in from keytab as kudu/127.24.205.188@KRBTEST.COM (short username kudu)
I20260810 01:41:41.362562 29589 webserver.cc:460] Webserver started at http://127.24.205.188:42529/ using document root <none> and password file <none>
I20260810 01:41:41.363126 29589 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:41.363220 29589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:41.363459 29589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:41.365609 29589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data/instance:
uuid: "60bf2ece8c2d4ae5a82c719130703ea2"
format_stamp: "Formatted at 2026-08-10 01:41:41 on dist-test-slave-t3q3"
server_key: "9d81454428a8de4418ef938f1f91957c"
server_key_iv: "fd1cbdbb6b026b36390d2f8d3779f4dd"
server_key_version: "encryptionkey@0"
I20260810 01:41:41.366232 29589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/wal/instance:
uuid: "60bf2ece8c2d4ae5a82c719130703ea2"
format_stamp: "Formatted at 2026-08-10 01:41:41 on dist-test-slave-t3q3"
server_key: "9d81454428a8de4418ef938f1f91957c"
server_key_iv: "fd1cbdbb6b026b36390d2f8d3779f4dd"
server_key_version: "encryptionkey@0"
I20260810 01:41:41.370013 29589 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:41:41.372400 29618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:41.373674 29589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:41.373818 29589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data,/tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/wal
uuid: "60bf2ece8c2d4ae5a82c719130703ea2"
format_stamp: "Formatted at 2026-08-10 01:41:41 on dist-test-slave-t3q3"
server_key: "9d81454428a8de4418ef938f1f91957c"
server_key_iv: "fd1cbdbb6b026b36390d2f8d3779f4dd"
server_key_version: "encryptionkey@0"
I20260810 01:41:41.373929 29589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:41.386571 29589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:41.389652 29589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:41.389864 29589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:41.397327 29589 rpc_server.cc:307] RPC server started. Bound to: 127.24.205.188:35257
I20260810 01:41:41.397634 29706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.205.188:35257 every 8 connection(s)
I20260810 01:41:41.398397 29589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/data/info.pb
I20260810 01:41:41.401268 29707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:41.403023 25398 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu as pid 29589
I20260810 01:41:41.403201 25398 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskdl8Mys/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786325801109519-25398-0/minicluster-data/master-2/wal/instance
I20260810 01:41:41.403522 25398 external_mini_cluster.cc:1428] Setting key b7ab6f6e0282f46e32c5b9a535bbbf56
I20260810 01:41:41.405790 29707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:41.418505 29463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.408204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.24.205.190:42155)
0810 01:41:41.408367 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.408372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.408735 (+ 363us) server_negotiation.cc:407] Connection header received
0810 01:41:41.408867 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.408869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.408915 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.408985 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.409777 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.410496 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.411626 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.411908 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.412033 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.414640 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.414647 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.414652 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.414682 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.416269 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.416804 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.416807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.416809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.416893 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.417281 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.417284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.417286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.417565 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.417667 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.418172 (+ 505us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.418306 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 01:41:41.419310 29711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.404988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47634 (local address 127.24.205.188:35257)
0810 01:41:41.405431 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.405450 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.405495 (+ 45us) server_negotiation.cc:407] Connection header received
0810 01:41:41.406276 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.406303 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.406746 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.407109 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.407857 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.409338 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.410485 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.411182 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.411333 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.414033 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.414039 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.414081 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.414111 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.416234 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.416786 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.416793 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.416794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.416936 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.417281 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.417284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.417286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.417797 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.417953 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.418204 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.418435 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":296,"thread_start_us":125,"threads_started":1}
I20260810 01:41:41.419307 29712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.408161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.190:42155 (local address 127.0.0.1:49748)
0810 01:41:41.408581 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.408644 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.408763 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.409054 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.409059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.409522 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.409645 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.409651 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.410612 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.410615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.411502 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.411510 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.412104 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.412114 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.412198 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.412712 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.412728 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.414456 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.416374 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.416383 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.416393 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.416680 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.416994 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.416997 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.416998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.417170 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.417671 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.417676 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.417883 (+ 207us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.418080 (+ 197us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.418534 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":122,"thread_start_us":153,"threads_started":1}
I20260810 01:41:41.420663 29707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.190@KRBTEST.COM
I20260810 01:41:41.429854 29712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.421223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.189:36265 (local address 127.0.0.1:44322)
0810 01:41:41.421353 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.421368 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.421444 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.421800 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.421804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.421976 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.422071 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.422077 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.422955 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.422960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.423496 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.423503 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.423990 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.423994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.424112 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.424598 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.424611 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.426157 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.428052 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.428054 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.428107 (+ 53us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.428410 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.428757 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.428760 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.428761 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.428842 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.429314 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.429316 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.429435 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.429561 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.429700 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 01:41:41.429947 29588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.421414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.24.205.189:36265)
0810 01:41:41.421582 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.421587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.421600 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:41:41.421638 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.421640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.421677 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.421781 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.422181 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.422839 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.423625 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.423877 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.423989 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.426310 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.426312 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.426314 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.426337 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.427947 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.428520 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.428529 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.428546 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.428645 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.428944 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.428947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.428949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.429214 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.429325 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.429614 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.429747 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:41:41.430958 29707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:41:41.431195 29463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.421816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49756 (local address 127.24.205.190:42155)
0810 01:41:41.421933 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.421937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.422309 (+ 372us) server_negotiation.cc:407] Connection header received
0810 01:41:41.422390 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.422393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.422436 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.422505 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.423045 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.423534 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.424434 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.424816 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.424923 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.427548 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.427553 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.427555 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.427582 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.429294 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.429760 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.429764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.429765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.429843 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.430172 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.430176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.430178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.430418 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.430663 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.430800 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.430916 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.188@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.205.189@KRBTEST.COM
I20260810 01:41:41.438231 29459 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } attempt: 3
I20260810 01:41:41.439718 29711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.431530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47646 (local address 127.24.205.188:35257)
0810 01:41:41.431631 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.431635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.431691 (+ 56us) server_negotiation.cc:407] Connection header received
0810 01:41:41.431828 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.431831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.431883 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.431954 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.432585 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.433214 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.434017 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.434242 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.434318 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.436430 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.436433 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.436436 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.436457 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.437993 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.438473 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.438476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.438477 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.438554 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.438844 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.438847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.438849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.439068 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.439169 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.439447 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.439595 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":30}
I20260810 01:41:41.439750 29574 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } attempt: 3
I20260810 01:41:41.439718 29712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.431456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47646)
0810 01:41:41.431637 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.431650 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.431734 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.431994 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.431997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.432205 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.432335 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.432346 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.433357 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.433360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.433897 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.433908 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.434352 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.434355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.434439 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.434911 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.434922 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.436298 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.438105 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.438111 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.438113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.438367 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.438664 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.438667 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.438668 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.438747 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.439206 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.439208 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.439297 (+ 89us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.439403 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.439538 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260810 01:41:41.442188 29588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.432528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44326 (local address 127.24.205.189:36265)
0810 01:41:41.432635 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.432642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.432655 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:41:41.432693 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.432695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.432732 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.432810 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.433373 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.433821 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.434765 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.435054 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.435141 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.437790 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.437793 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.437795 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.437817 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.439564 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.440561 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.440564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.440565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.440681 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.441067 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.441072 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.441073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.441296 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.441524 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.441934 (+ 410us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.442041 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:41:41.444267 29707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: Bootstrap starting.
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326101, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.189@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
I20260810 01:41:41.445873 25398 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:41:41.447207 29707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:41.448002 29707 log.cc:824] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:41.447080 29413 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6b4d2f6a99444f0da6615a7b876cacce"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49756
Aug 10 01:41:41 dist-test-slave-t3q3 krb5kdc[29316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326100, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.205.190@KRBTEST.COM for kudu/127.24.205.188@KRBTEST.COM
I20260810 01:41:41.450439 29707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: No bootstrap required, opened a new log
I20260810 01:41:41.451315 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.440214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47660)
0810 01:41:41.440359 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.440375 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.440448 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.441422 (+ 974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.441425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.441595 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.441687 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.441693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.442731 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.442735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.443392 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.443401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.443931 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.443935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.444030 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.444552 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.444565 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.445945 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.449489 (+ 3544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.449494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.449497 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.449767 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.450114 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.450118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.450123 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.450214 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.450793 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.450797 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.450906 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.450997 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.451127 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 01:41:41.451964 29711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.440457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47660 (local address 127.24.205.188:35257)
0810 01:41:41.441147 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.441150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.441162 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:41:41.441193 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.441195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.441243 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.441802 (+ 559us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.441904 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.442583 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.443517 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.443808 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.443919 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.446067 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.446071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.446073 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.446098 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.449353 (+ 3255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.449902 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.449905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.449907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.449995 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.450362 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.450367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.450372 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.450650 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.451611 (+ 961us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.451694 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.451826 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":613,"spinlock_wait_cycles":4480}
I20260810 01:41:41.453279 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.439020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.205.188:35257 (local address 127.0.0.1:47654)
0810 01:41:41.439208 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:41.439234 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:41.439319 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:41.440164 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:41.440167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:41.440356 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:41.440481 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.440491 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.444863 (+ 4372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.444867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.445759 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:41.445772 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.446775 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.446781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:41.447124 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.447616 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:41.447630 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:41.449112 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:41.451218 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.451221 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.451223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.451476 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.451844 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:41.451847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:41.451849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:41.451939 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:41.452750 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:41.452753 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:41.452855 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 01:41:41.452984 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 01:41:41.453128 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260810 01:41:41.453513 29716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.439011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.24.205.188:35257)
0810 01:41:41.439882 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.439892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.439906 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:41:41.439941 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.439946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.439997 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.440128 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.440614 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.444723 (+ 4109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.445919 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.446623 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.447348 (+ 725us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.449257 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.449262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.449265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.449294 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.451120 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.451631 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.451634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.451636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.451739 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.452041 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.452047 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.452049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.452618 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.452741 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.453058 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.453186 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"spinlock_wait_cycles":1408,"thread_start_us":132,"threads_started":1}
I20260810 01:41:41.454793 29707 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.455039 29707 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60bf2ece8c2d4ae5a82c719130703ea2, State: Initialized, Role: FOLLOWER
I20260810 01:41:41.455134 29574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: Bootstrap starting.
I20260810 01:41:41.455422 29707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.455976 29719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.456247 29719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:41.456485 29459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce: Bootstrap starting.
I20260810 01:41:41.456895 29707 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:41.457851 29574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:41.458640 29574 log.cc:824] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:41.459048 29459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:41.459905 29459 log.cc:824] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:41.462007 29459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce: No bootstrap required, opened a new log
W20260810 01:41:41.462182 29733 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:41.462275 29733 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:41.464040 29574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: No bootstrap required, opened a new log
I20260810 01:41:41.460769 29589 master_runner.cc:186] Error getting master registration for 127.24.205.190:42155: OK, instance_id { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" instance_seqno: 1786326100971368 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:41:41.464700 29589 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:41:41.465052 29459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.465279 29459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4d2f6a99444f0da6615a7b876cacce, State: Initialized, Role: FOLLOWER
I20260810 01:41:41.465574 29459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.466104 29740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.466292 29740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:41.466830 29459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:41.466923 29413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:41:41.467053 29413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [term 0 FOLLOWER]: Advancing to term 1
W20260810 01:41:41.467517 29376 tablet.cc:2369] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:41:41.468174 29574 raft_consensus.cc:348] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.468389 29574 raft_consensus.cc:729] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fec9ca515d294693b33eef1dc0e61b16, State: Initialized, Role: FOLLOWER
I20260810 01:41:41.468694 29574 consensus_queue.cc:260] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.468760 29413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.469925 29413 leader_election.cc:288] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [CANDIDATE]: Term 1 election: Requested vote from peers fec9ca515d294693b33eef1dc0e61b16 (127.24.205.189:36265), 60bf2ece8c2d4ae5a82c719130703ea2 (127.24.205.188:35257)
I20260810 01:41:41.470062 29574 sys_catalog.cc:564] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:41.470701 29668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b4d2f6a99444f0da6615a7b876cacce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "60bf2ece8c2d4ae5a82c719130703ea2"
I20260810 01:41:41.470939 29668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:41.472311 29668 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4d2f6a99444f0da6615a7b876cacce in term 1.
I20260810 01:41:41.472736 29370 leader_election.cc:302] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60bf2ece8c2d4ae5a82c719130703ea2, 6b4d2f6a99444f0da6615a7b876cacce; no voters:
I20260810 01:41:41.473075 29740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:41.473101 29533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b4d2f6a99444f0da6615a7b876cacce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fec9ca515d294693b33eef1dc0e61b16"
I20260810 01:41:41.473316 29533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:41.473349 29740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [term 1 LEADER]: Becoming Leader. State: Replica: 6b4d2f6a99444f0da6615a7b876cacce, State: Running, Role: LEADER
I20260810 01:41:41.473680 29740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } }
I20260810 01:41:41.474618 29533 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4d2f6a99444f0da6615a7b876cacce in term 1.
I20260810 01:41:41.476634 29749 sys_catalog.cc:455] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.476811 29749 sys_catalog.cc:458] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:41.479359 29781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b4d2f6a99444f0da6615a7b876cacce. Latest consensus state: current_term: 1 leader_uuid: "6b4d2f6a99444f0da6615a7b876cacce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.479491 29781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:41.479971 29338 master_runner.cc:263] No leader master found from master 6b4d2f6a99444f0da6615a7b876cacce
I20260810 01:41:41.480044 29338 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:41:41.480151 29779 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:41.480242 29779 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:41.489030 29463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.473659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49760 (local address 127.24.205.190:42155)
0810 01:41:41.473782 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.473786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.474685 (+ 899us) server_negotiation.cc:407] Connection header received
0810 01:41:41.474897 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.474901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.474946 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.474993 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.477493 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.478338 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.482966 (+ 4628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.483291 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.483357 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.485223 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.485227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.485230 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.485259 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.486975 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.487513 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.487517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.487519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.487615 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.487947 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.487950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.487952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.488223 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.488346 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.488737 (+ 391us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.488870 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:41:41.492725 29716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.475915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47664 (local address 127.24.205.188:35257)
0810 01:41:41.476029 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.476033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.476055 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:41:41.476137 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.476143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.476196 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.476279 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.481020 (+ 4741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.481797 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.483366 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.484130 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.484219 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.488876 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.488880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.488883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.488910 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.490731 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.491236 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.491240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.491242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.491336 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.491677 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.491681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.491683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.491905 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.492018 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.492431 (+ 413us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.492558 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:41:41.498019 29588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:41.473808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44328 (local address 127.24.205.189:36265)
0810 01:41:41.473913 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.473918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.476230 (+ 2312us) server_negotiation.cc:407] Connection header received
0810 01:41:41.476400 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.476403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.476445 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.476492 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.480781 (+ 4289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.481505 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.486067 (+ 4562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:41.486603 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:41.486695 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:41.494226 (+ 7531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:41.494230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:41.494233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:41.494265 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:41.496009 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.496633 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.496637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.496639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.496730 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:41.497038 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:41.497042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:41.497043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:41.497250 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:41.497375 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:41.497721 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 01:41:41.497838 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 01:41:41.489030 29758 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:41:41.500169 29758 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:41:41.500272 29788 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:41.501304 29788 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:41.509971 29533 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [term 1 FOLLOWER]: Refusing update from remote peer 6b4d2f6a99444f0da6615a7b876cacce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:41.510349 29668 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [term 1 FOLLOWER]: Refusing update from remote peer 6b4d2f6a99444f0da6615a7b876cacce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:41.510963 29781 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [LEADER]: Connected to new peer: Peer: permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:41.511436 29740 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [LEADER]: Connected to new peer: Peer: permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:41.515102 29719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b4d2f6a99444f0da6615a7b876cacce. Latest consensus state: current_term: 1 leader_uuid: "6b4d2f6a99444f0da6615a7b876cacce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.515218 29719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:41.517249 29749 sys_catalog.cc:455] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b4d2f6a99444f0da6615a7b876cacce. Latest consensus state: current_term: 1 leader_uuid: "6b4d2f6a99444f0da6615a7b876cacce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.517390 29749 sys_catalog.cc:458] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:41.522497 29781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b4d2f6a99444f0da6615a7b876cacce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.522611 29781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:41.522769 29749 sys_catalog.cc:455] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b4d2f6a99444f0da6615a7b876cacce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.522876 29749 sys_catalog.cc:458] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:41.522989 29790 mvcc.cc:205] Tried to move back new op lower bound from 7316791711775756288 to 7316791711639228416. Current Snapshot: MvccSnapshot[applied={T|T < 7316791711775756288}]
I20260810 01:41:41.525406 29781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b4d2f6a99444f0da6615a7b876cacce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.525511 29781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:41.526539 29793 mvcc.cc:205] Tried to move back new op lower bound from 7316791711775756288 to 7316791711639228416. Current Snapshot: MvccSnapshot[applied={T|T < 7316791711775756288}]
I20260810 01:41:41.528330 29719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b4d2f6a99444f0da6615a7b876cacce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4d2f6a99444f0da6615a7b876cacce" member_type: VOTER last_known_addr { host: "127.24.205.190" port: 42155 } } peers { permanent_uuid: "fec9ca515d294693b33eef1dc0e61b16" member_type: VOTER last_known_addr { host: "127.24.205.189" port: 36265 } } peers { permanent_uuid: "60bf2ece8c2d4ae5a82c719130703ea2" member_type: VOTER last_known_addr { host: "127.24.205.188" port: 35257 } } }
I20260810 01:41:41.528439 29719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:41:41.529385 29794 mvcc.cc:205] Tried to move back new op lower bound from 7316791711775756288 to 7316791711639228416. Current Snapshot: MvccSnapshot[applied={T|T < 7316791711775756288}]
I20260810 01:41:41.535197 29788 catalog_manager.cc:1347] Generated new cluster ID: 0a6134d258224f7ab893864823ba2f48
I20260810 01:41:41.535272 29788 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:41.554986 29788 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:41.556319 29788 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:41.572572 29788 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b4d2f6a99444f0da6615a7b876cacce: Generated new TSK 0
I20260810 01:41:41.573523 29788 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:41:41.612963 29716 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.609732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47666 (local address 127.24.205.188:35257)
0810 01:41:41.609861 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.609865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.611815 (+ 1950us) server_negotiation.cc:407] Connection header received
0810 01:41:41.612017 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.612021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.612099 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.612154 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.612834 (+ 680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47666: BlockingRecv error: recv got EOF from 127.0.0.1:47666 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 01:41:41.614399 29463 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.610225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49762 (local address 127.24.205.190:42155)
0810 01:41:41.610335 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.610339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.613484 (+ 3145us) server_negotiation.cc:407] Connection header received
0810 01:41:41.613675 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.613678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.613728 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.613779 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.614275 (+ 496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49762: BlockingRecv error: recv got EOF from 127.0.0.1:49762 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 01:41:41.615741 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.611209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44332 (local address 127.24.205.189:36265)
0810 01:41:41.611325 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.611329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.614872 (+ 3543us) server_negotiation.cc:407] Connection header received
0810 01:41:41.615041 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.615045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.615096 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.615145 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.615627 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44332: BlockingRecv error: recv got EOF from 127.0.0.1:44332 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 01:41:41.620141 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.618608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44340 (local address 127.24.205.189:36265)
0810 01:41:41.618709 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.618713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.619176 (+ 463us) server_negotiation.cc:407] Connection header received
0810 01:41:41.619385 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.619388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.619458 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.619520 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.620015 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44340: BlockingRecv error: recv got EOF from 127.0.0.1:44340 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 01:41:41.626061 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.624679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44348 (local address 127.24.205.189:36265)
0810 01:41:41.624777 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.624781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.625228 (+ 447us) server_negotiation.cc:407] Connection header received
0810 01:41:41.625401 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.625405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.625451 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.625510 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.625969 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44348: BlockingRecv error: recv got EOF from 127.0.0.1:44348 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 01:41:41.631568 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.630104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44352 (local address 127.24.205.189:36265)
0810 01:41:41.630194 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.630197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.630718 (+ 521us) server_negotiation.cc:407] Connection header received
0810 01:41:41.630900 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.630905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.630954 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.631004 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.631467 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44352: BlockingRecv error: recv got EOF from 127.0.0.1:44352 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260810 01:41:41.639572 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.637850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44362 (local address 127.24.205.189:36265)
0810 01:41:41.637984 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.637988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.638579 (+ 591us) server_negotiation.cc:407] Connection header received
0810 01:41:41.638789 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.638795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.638847 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.638900 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.639456 (+ 556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44362: BlockingRecv error: recv got EOF from 127.0.0.1:44362 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260810 01:41:41.651825 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.649986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44364 (local address 127.24.205.189:36265)
0810 01:41:41.650131 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.650138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.650799 (+ 661us) server_negotiation.cc:407] Connection header received
0810 01:41:41.651018 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.651022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.651073 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.651131 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.651708 (+ 577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44364: BlockingRecv error: recv got EOF from 127.0.0.1:44364 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 01:41:41.678521 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.676599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44366 (local address 127.24.205.189:36265)
0810 01:41:41.676732 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.676736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.677442 (+ 706us) server_negotiation.cc:407] Connection header received
0810 01:41:41.677670 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.677674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.677729 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.677780 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.678390 (+ 610us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44366: BlockingRecv error: recv got EOF from 127.0.0.1:44366 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 01:41:41.714608 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.713290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44380 (local address 127.24.205.189:36265)
0810 01:41:41.713476 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.713481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.713657 (+ 176us) server_negotiation.cc:407] Connection header received
0810 01:41:41.713850 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.713854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.713904 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.714003 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.714501 (+ 498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44380: BlockingRecv error: recv got EOF from 127.0.0.1:44380 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260810 01:41:41.782269 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.780962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44396 (local address 127.24.205.189:36265)
0810 01:41:41.781152 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.781158 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.781322 (+ 164us) server_negotiation.cc:407] Connection header received
0810 01:41:41.781507 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.781510 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.781568 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.781671 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.782145 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44396: BlockingRecv error: recv got EOF from 127.0.0.1:44396 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260810 01:41:41.913883 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:41.912539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44406 (local address 127.24.205.189:36265)
0810 01:41:41.912707 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:41.912712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:41.912866 (+ 154us) server_negotiation.cc:407] Connection header received
0810 01:41:41.913096 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:41.913098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:41.913154 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:41.913251 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:41.913743 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44406: BlockingRecv error: recv got EOF from 127.0.0.1:44406 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260810 01:41:42.173631 29588 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:41:42.172317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44422 (local address 127.24.205.189:36265)
0810 01:41:42.172486 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:42.172491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:42.172634 (+ 143us) server_negotiation.cc:407] Connection header received
0810 01:41:42.172833 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:42.172839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:42.172891 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:42.173004 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:42.173499 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44422: BlockingRecv error: recv got EOF from 127.0.0.1:44422 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 01:41:42.463661 29733 catalog_manager.cc:1259] Loaded cluster ID: 0a6134d258224f7ab893864823ba2f48
I20260810 01:41:42.463773 29733 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: loading cluster ID for follower catalog manager: success
I20260810 01:41:42.465816 29733 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: acquiring CA information for follower catalog manager: success
I20260810 01:41:42.467217 29733 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 60bf2ece8c2d4ae5a82c719130703ea2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:41:42.481583 29779 catalog_manager.cc:1259] Loaded cluster ID: 0a6134d258224f7ab893864823ba2f48
I20260810 01:41:42.481673 29779 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: loading cluster ID for follower catalog manager: success
I20260810 01:41:42.483422 29779 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: acquiring CA information for follower catalog manager: success
I20260810 01:41:42.484676 29779 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fec9ca515d294693b33eef1dc0e61b16: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:41:42.692251 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:42.687798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44436 (local address 127.24.205.189:36265)
0810 01:41:42.688120 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:42.688129 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:42.688188 (+ 59us) server_negotiation.cc:407] Connection header received
0810 01:41:42.688334 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:42.688337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:42.688463 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:42.688590 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:42.688952 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.689519 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.690614 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.690871 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.690957 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:42.691298 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:42.691762 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:42.691868 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:42.692001 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 01:41:42.692053 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":89,"threads_started":1}
I20260810 01:41:42.698804 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:42.695365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47680 (local address 127.24.205.188:35257)
0810 01:41:42.695635 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:42.695638 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:42.695652 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:41:42.695729 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:42.695731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:42.695842 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:42.695946 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:42.696220 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.696735 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.697536 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.697747 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.697823 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:42.698081 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:42.698482 (+ 401us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:42.698591 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:42.698644 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 01:41:42.698689 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":99,"threads_started":1}
I20260810 01:41:42.705684 29908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:42.702214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.24.205.188:35257)
0810 01:41:42.702318 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:42.702322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:42.702336 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:41:42.702379 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:42.702382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:42.702430 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:42.702511 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:42.702791 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.703560 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.704584 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.704802 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.704914 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:42.705188 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:42.705260 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:42.705328 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:42.705454 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 01:41:42.705525 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 01:41:42.706368 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:42.702298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44450 (local address 127.24.205.189:36265)
0810 01:41:42.702409 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:42.702413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:42.702508 (+ 95us) server_negotiation.cc:407] Connection header received
0810 01:41:42.702676 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:42.702679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:42.702723 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:42.702821 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:42.703082 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.703778 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.705088 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.705395 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.705494 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:42.705852 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:42.705953 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:42.706024 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:42.706192 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 01:41:42.706251 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 01:41:42.707085 29919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:42.701829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49776 (local address 127.24.205.190:42155)
0810 01:41:42.702525 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:42.702532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:42.702547 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:41:42.702636 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:42.702639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:42.702818 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:42.702935 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:42.703287 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.703927 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.705129 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:42.705513 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:42.705616 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:42.706048 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:42.706403 (+ 355us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:42.706522 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:42.706853 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 01:41:42.706938 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":88,"threads_started":1}
I20260810 01:41:42.713142 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 29338
I20260810 01:41:42.728770 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 29472
I20260810 01:41:42.742970 25398 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskdl8Mys/build/debug/bin/kudu with pid 29589
2026-08-10T01:41:42Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3352 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6813 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (301606 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST